• Register
PhysicsOverflow is a next-generation academic platform for physicists and astronomers, including a community peer review system and a postgraduate-level discussion forum analogous to MathOverflow.

Welcome to PhysicsOverflow! PhysicsOverflow is an open platform for community peer review and graduate-level Physics discussion.

Please help promote PhysicsOverflow ads elsewhere if you like it.


PO is now at the Physics Department of Bielefeld University!

New printer friendly PO pages!

Migration to Bielefeld University was successful!

Please vote for this year's PhysicsOverflow ads!

Please do help out in categorising submissions. Submit a paper to PhysicsOverflow!

... see more

Tools for paper authors

Submit paper
Claim Paper Authorship

Tools for SE users

Search User
Reclaim SE Account
Request Account Merger
Nativise imported posts
Claim post (deleted users)
Import SE post

Users whose questions have been imported from Physics Stack Exchange, Theoretical Physics Stack Exchange, or any other Stack Exchange site are kindly requested to reclaim their account and not to register as a new user.

Public \(\beta\) tools

Report a bug with a feature
Request a new functionality
404 page design
Send feedback


(propose a free ad)

Site Statistics

205 submissions , 163 unreviewed
5,064 questions , 2,215 unanswered
5,347 answers , 22,731 comments
1,470 users with positive rep
818 active unimported users
More ...

  Do bipartite spin glasses have simple relaxation dynamics?

+ 3 like - 0 dislike

From what I gather, a Boltzmann machine (BM) is essentially a spin glass with no applied field evolving under Glauber dynamics (if this is at all mistaken, I don't think it will be off enough to materially affect the following, but I would welcome elaboration anyway). For background, see, e.g. Amit et al., PRA 32, 1007 (1985): their suggestion that the "detailed dynamic properties of the...Hopfield models, e.g. the rate of relaxation" be studied is at the root of my question below.

Now, a restricted BM (RBM) is a bipartite BM, and the maximal independent sets correspond to visible and hidden units/nodes. RBMs can be "stacked" to form a deep BM (DBM), and these DBMs have attracted a lot of interest over the past 5-6 years due to the practicality of a training algorithm for them.

It is well known that spin glasses have very complicated dynamics: in particular, a multitude of separated timescales contribute to their evolution. That said, I have seen recent work that (upon a cursory look) seems to suggest that bipartite spin glasses/RBMs have reasonably well-defined equilibrium (or steady state?) behavior, in which convex combinations of the "visible" and "hidden" glasses characterize the overall situation (Barra et al., J. Phys A 44, 245002 (2011)--NB. I have only skimmed this).

This in turn seems to suggest to me that the relaxation dynamics of these bipartite spin glasses/RBMs is comparatively tractable. So my question is:

Is the preceding sentence justified? And if so, what do the relaxation dynamics of bipartite spin glasses/RBMs look like? Is there a single independent characteristic timescale (e.g., relaxation and mixing times are different in general, but closely related and certainly not independent)?

I would welcome any references within the last 5 years--not, e.g. MacKay, etc.

(NB. A less detailed version of this question was posted at stats.stackexchange a few days ago.)

This post has been migrated from (A51.SE)
asked Feb 14, 2012 in Theoretical Physics by S Huntsman (405 points) [ no revision ]
Regarding the sentence: "relaxation dynamics of these bipartite spin glasses/RBMs is comparatively tractable", what physical quantities would you like to compute? Are you trying to sampling from the ground states according to a Boltzmann distribution or trying to compute the partition function (or related quantity)?

This post has been migrated from (A51.SE)
I am interested in the mixing or relaxation time.

This post has been migrated from (A51.SE)

Your answer

Please use answers only to (at least partly) answer questions. To comment, discuss, or ask for clarification, leave a comment instead.
To mask links under text, please type your text, highlight it, and click the "link" button. You can then enter your link URL.
Please consult the FAQ for as to how to format your post.
This is the answer box; if you want to write a comment instead, please use the 'add comment' button.
Live preview (may slow down editor)   Preview
Your name to display (optional):
Privacy: Your email address will only be used for sending these notifications.
Anti-spam verification:
If you are a human please identify the position of the character covered by the symbol $\varnothing$ in the following word:
Then drag the red bullet below over the corresponding character of our banner. When you drop it there, the bullet changes to green (on slow internet connections after a few seconds).
Please complete the anti-spam verification

user contributions licensed under cc by-sa 3.0 with attribution required

Your rights