| J. Phys. A: Math. Theor. 41 No 37 (19 September 2008) 372001 (12pp) |
| doi:10.1088/1751-8113/41/37/372001 |
Freezing and extreme-value statistics in a random energy model with logarithmically correlated potential
Yan V Fyodorov1 and Jean-Philippe Bouchaud2
1 School of Mathematical Sciences, University of Nottingham, Nottingham NG72RD, UK
2 Science & Finance, Capital Fund Management 6-8 Bd Haussmann, 75009 Paris, France
Received 28 May 2008, in final form 19 July 2008
Published 7 August 2008
| Abstract. We investigate some implications of the freezing scenario proposed by Carpentier and Le Doussal (CLD) for a random energy model (REM) with logarithmically correlated random potential. We introduce a particular (circular) variant of the model, and show that the integer moments of the partition function in the high-temperature phase are given by the well-known Dyson Coulomb gas integrals. The CLD freezing scenario allows one to use those moments for extracting the distribution of the free energy in both high- and low-temperature phases. In particular, it yields the full distribution of the minimal value in the potential sequence. This provides an explicit new class of extreme-value statistics for strongly correlated variables, manifestly different from the standard Gumbel class. PACS numbers: 05.40.–a, 75.10.Nr |
1. Introduction
The random energy model (REM) introduced by Derrida in [1] is characterized by the partition function
, where β is the inverse temperature, and Vi for i = 1, ..., M are random variables with the typical variance
V2i
= V2 = O(log M) for M → ∞. Such a model, as well as its generalized version (GREM) [2, 3] continues to play a paradigmatic role in statistical mechanics of disordered systems. Simple enough to allow for a detailed analytical investigation by various methods, the freezing transition exemplified by REM appears to be a rather generic phenomenon. It emerges with surprising regularity in a variety of physical situations, ranging from transparency of random media [4], directed polymers in random environment [5], p-spin glass models and the glass transition [6], random heteropolymers and models of protein folding [7] to properties of quantum particles in a random magnetic field [8, 9], and thermodynamics of a single particle in random Gaussian landscapes [10]. It is also a rich model from purely probabilistic point of view [11], and has an interesting dynamical counterpart: aging [12].
As the low-temperature behaviour in statistical mechanics is obviously controlled by the lowest available energies, it is not surprising that a detailed description of the freezing phenomenon is intimately related to the so-called extreme-value statistics of random variables [13]. For independent, identically distributed variables Vi, the cumulative probability distribution Pm(x) of Vm = min{V1, ..., VM} is well understood in mathematical literature and, provided the support of the distribution extends to –∞ but decays faster than any power-law, is given in the limit M
1 by the Gumbel law
where the constants aM and bM depend explicitly on the distribution of Vi, but the double-exponential shape of the Gumbel law is very robust (universal). This universality extends to a very broad class of correlated variables provided those correlations decay fast enough, see a detailed description in [14]. For a mathematically rigorous analysis of REM and GREM based, in particular, on the extreme-value statistics, see [15]; see also [16] for recent developments.
A few years ago Carpentier and Le Doussal (CLD) [9] studied a specific case of correlated random variables that is arguably the richest, most challenging, and relevant for applications. More precisely, thinking of the index i as referring to the sites of a certain lattice, the covariance
ViVj
considered by CLD depended on the distance d(i, j) between those sites logarithmically. An independent support of the fact that logarithmically correlated potentials should play a special role was obtained recently through a thorough analysis of statistical mechanics of a single particle in high-dimensional random energy landscapes [10].
To understand the extreme-value statistics in the logarithmic case and to relate it to a REM-like freezing transition CLD developed a powerful, albeit non-rigorous, real space renormalization group approach to the distribution
of the partition function Zβ. In this way they discovered that logarithmic models represent, in a sense, continuous analogues of directed polymers on disordered trees, a result somewhat anticipated in [8]. The statistical mechanics of the directed polymer problem on a tree is known to be amenable to a travelling wave analysis, see the celebrated paper [5]. Similarly, for the logarithmic case the Laplace transform of the distribution
was also shown to satisfy a kind of travelling wave equation (see also works [17] for a relation between the travelling waves and the extreme-value statistics, in particular, in the context of the zero temperature directed polymer problem on a tree). Solutions of equations of that type are known to exhibit a characteristic change of the shape at some critical front velocity, and following [5] that change was interpreted by CLD as a signal of a REM-like freezing. In particular, the CLD analysis revealed that such a transition implies, among other properties, a universal non-Gumbel shape of the far-left tail for the cumulative distribution of the minimal value of logarithmically correlated variables: Pm(x → –∞) ≈ 1 – const|x| eax which is clearly different from the Gumbel tail Pm(x → –∞) ≈ 1 – const eax.
Although CLD's renormalization group is able to predict successfully the universal far-tail features of the distribution expected to be shared by all logarithmically correlated potentials, the calculation of the full distribution for a given potential is beyond the scope of that method. Indeed, the renormalization procedure needs specifying what the authors called a `fusion of environments' rule [9]. As CLD convincingly argue, the precise form of that rule is not important for recovering universal properties. But the actual shape of the travelling wave equation certainly depends on the particular fusion rule employed. As no guiding principle for the fusion rule selection had been provided, a more detailed analysis of specific models appears to be problematic.
The present paper grew out of attempts to overcome the above difficulty. Our main observation is that for a particular variant of the logarithmically-correlated REM a more detailed analysis seems to be possible. In particular, we are able to conjecture the full distribution function Pm(x) pertinent for the case considered. Namely, after appropriate rescaling the cumulative distribution Pm(x) of the minimum turns out to be given by the central result of this work
where K1(x) stands for the modified Bessel (Macdonald) function, and the parameter βc is given by the inverse transition temperature in the model. As such, the corresponding distribution is manifestly different from the standard Gumbel double-exponential form.
Our method draws its inspiration from CLD analysis and is essentially based on the pattern of the freezing transition revealed in [5, 9]. However, we do not resort to the renormalization group construction or travelling wave technique, and in this way circumvent the need to know the microscopic fusion rule. Instead, we demonstrate below that assuming CLD freezing scenario provides a way to extend the moments of the partition function from the high-temperature phase to the region below the transition. Roughly speaking, if those moments can be explicitly calculated above the transition—as is the case for both the standard REM as well as our variant of the logarithmic model—they can be used to conjecture the shape of the Laplace transform of the probability density above the transition point. Then the CLD approach can be used to recover the full distribution of the partition function/free energy below the transition, yielding in particular the extreme-value statistics.
The structure of the paper is the following. We start with a short general discussion of CLD freezing scenario, in particular its implications for the moments of the partition function in the low-temperature phase. As an illustration we show how CLD scenario can be used in the standard REM case to recover the exact low-temperature expressions for the partition function moments, obtained long ago by Gardner and Derrida via a rather tedious analysis [3]. After that we introduce and analyse the particular (circular) version of the one-dimensional logarithmically correlated REM.
2. CLD freezing scenario: general relations and implications
The central object of the subsequent analysis is the Laplace-transform Gβ(p) of the probability distribution
of the partition function: Gβ(p) =
exp{–pZβ}
. Here and henceforth the angular brackets stand for the expectation with respect to the distribution of random variables Vi. Our approach is based on the assumption that such a Laplace transform can be efficiently found in the high-temperature phase.
Following [5, 9] we introduce the variable x via p = eβx and consider the function
. Extending the Derrida–Spohn scenario, CLD postulate that in the thermodynamic limit M
1 the latter function has a shape of a travelling wave, that is
where we introduced the parameter L to identify with notations used in [9], and l.o.t. stands for the lower order terms when L → ∞.Note1 In general, both the travelling wave profile gβ(y) and the wave velocity c(β) depend on the inverse temperature β. The REM-like transition in this approach is described by a `freezing' of both the velocity and the profile function at a certain transition temperature β = βc so that in the full low-temperature phase β ≥ βc one has
By the very definition of the function
we then have the following relation for β ≥ βc:
which fixes the shape of the Laplace transform
in the whole temperature range below the transition point.
Equipped with such a scenario, we will exploit that the knowledge of the Laplace transform allows one to calculate the moments of the partition function below the transition by employing the standard identity:
where Γ(x) stands for the Euler Gamma function, and we used that
.
According to the freezing scenario, the mean value of the free energy in the low-temperature phase is to leading order in L
1 temperature independent, and is given by
. Being interested in the fluctuations of the free energy, we introduce the random variable f = F –
F
whose probability density we denote
. After changing the integration variable in (6) to
, introducing s = –βν and integrating once by parts we observe that (6) takes the following form:
Thus, the only function needed for investigating the low-temperature phase is the shape of the travelling wave profile gβ(y) at the critical point β = βc. For a general nonzero temperature βc < β < ∞ one can extract the explicit form of the free-energy distribution
by noting that the analytical continuation s → is converts the relation (7) to a Fourier transform which as we shall shortly see can be frequently inverted explicitly. A particular simple relation is obtained in the zero-temperature limit β → ∞ where the free energy simply reduces to the minimum value of all random energies in the sample F → Vm = mini{Vi}. It is immediately clear from (7) that
yielding a very general relation between the shape of the critical profile
and the probability density
of the fluctuations of the extreme values in the sample:
.
Let us briefly demonstrate how this method works for the standard REM with i.i.d. Gaussian sequence of Vi. Introducing the notation
, the analysis of [9] demonstrated that everywhere in the high-temperature phase β ≤ βc the Laplace transform is given by
Identifying L = ln M as in (3) we find from (9) and the correspondence
the REM travelling wave profile which is given by
In particular, when approaching the transition point β = βc the shape and velocity of the travelling wave tends to the limiting values
According to the general discussion, the Laplace transform
of the probability distribution of the partition function in the low-temperature phase β > βc can be found from
where we again used the correspondence
. In turn, the last expression can be immediately employed to recover the (non-integer) moments of the partition function from the first of relations in (6). Substituting there
from (12) yields after a straightforward manipulation
valid as long as
. The latter moments are, to leading approximation, precisely those obtained by Gardner and Derrida [3], and coincide, as expected from general arguments, with the moments of a totally asymmetric Lévy stable distribution of index βc/β [13, 15, 18]. Finally, the above moments allow one to recover the distribution of the free-energy fluctuations in the low-temperature phase of the REM, which seems not to be written explicitly in the literature. Namely, making an analytic continuation ν → is/β, and introducing
we note that (13) takes a form of the Fourier transform of the probability density for f, see (7). Inverting that transform gives
In particular, the zero-temperature limit β → ∞ coincides with the general relation (8) between
and
, as given by equation (11), which immediately yields the famous Gumbel distribution for the minimal energy. It is also evident that the far-left tail f → –∞ of the probability density
is of the Gumbel form everywhere in the low-temperature phase β > βc, again expected from general arguments [13, 15, 18].
3. The circular logarithmic REM
3.1. Definition of the model and the moments in the high-temperature phase
Consider the lattice of M points positioned equidistantly at the circumference of a unit circle. Their angular coordinates are given by
. With each point we associate a Gaussian random variable Vi, with position-independent variance
V2i
= V2 and covariances chosen to be
For the consistency of the procedure we have to choose variance V2 in a way ensuring positive definiteness of the full covariance matrix with entries V2δkl + (1 – δkl)Ckl. The condition amounts to V2 > –λmax, with λmax being the largest eigenvalue of the matrix
with entries Ckl. The matrix
is by definition a circulant real symmetric, with zero diagonal. Hence, its eigenvalues are given by λq = ∑Ml = 2 C1lωl–1q, where
are roots of Mth degree from unity. The largest eigenvalue corresponds to q = 0, when ωq = 1. Then we have
Using the identity:
we see that λmax = –2g2ln M, so we have to choose the variance to satisfy V2 = 2g2ln M + W, with an arbitrary positive W > 0. In what follows we assume that W = O(1) when M
1 and therefore can be safely neglected if we are interested only in the leading terms in the thermodynamic limit.
We define the partition function for our model in the standard way through
, with the goal to evaluate positive integer moments
[Zβ]n
in the limit M
1. The expected value of the partition function is obviously independent of the covariance and is given by the standard REM expression,
Zβ
= exp{ln M[1 + β2g2]}, so the first nontrivial moment is
Introducing
for k = 1, 2, ..., M we see that the second term in (16) is a kind of Riemann sum, and that in the limit M → ∞ can be approximated as
The first line in (17) corresponds to the convergent integral in the limit M → ∞ which can be easily evaluated by reducing it to the standard Euler's integral of the first kind, see [22], p 898. In contrast, the second line is obtained by extracting the leading term of the divergent integral. Comparing now second `off-diagonal' term in (16) with the first `diagonal' one, we find that for 2β2g2 > 1 the diagonal and off-diagonal contributions are of the same order, whereas for 2β2g2 < 1 the off-diagonal contribution dominates. Finally, we arrive at
The case of a general positive integer moment can be treated along the same lines. Denoting
we use
where in the second line we regrouped the terms according to partitions of the integer n into the sum of nonnegative integers with length k (i.e. the number of nonzero parts) taking values k = 1, ..., n. For example, partitions of the length k = 1 are sets {p1, ..., pM} with all but one pj equal to zero, and with the remaining nonzero integer taking the value p = n. The total contribution of those partitions is obviously
which is the first term in (19). Similarly, the contribution of all partitions of the length k = 2 is precisely the second term in the above expression, and so on. Finally, we perform the ensemble averaging of the above sum using the identity
valid in the case of all different indices in the set i1, ..., ik. In the limit M → ∞ we then find by inspection the dominating terms. After manipulations generalizing those we performed earlier for n = 2 case we find the following general expression:
where
The explicit expression for the factor O(1) in the second line of (21) is rather complicated, but is actually not needed for our purposes. Finally, using the symmetry of the integrand in (22) and noting that
one observes that (22) is a particular case of the so-called Morris integral (related to the famous Selberg integral) whose value was first conjectured by Dyson in his studies of the Coulomb gas problem (see a very informative historic account and further references in [19])
The integral is clearly finite provided β2g2 < 1/n ≤ 1, and is divergent otherwise. The condition βg < 1 defines the high-temperature phase of the model. Note a certain similarity between our calculations and those arising in the framework of the multifractal random walk model of Bacry, Muzy and Delour [20].
The crucial point of our analysis is the ability to offer the explicit form of the probability density
of the partition function Zβ = Z > 0 which precisely reproduces the expressions for the moments (21). It is given by
where we defined Z* = e2ln M and introduced for βg < 1 the two functions:
and
To understand the structure of
note that the growth rate of the moments in the second line of equation (21) dictates that the far tail of the distribution must be of a log-normal nature. This is exemplified by the choice (26) for
. On the other hand, the first line in (21) and the expressions (23) yield the probability density of the form
in equation (25). The crossover value Z = Z* is determined from the requirement for the leading exponential terms in the two pieces of the probability density to match smoothly, i.e.
for M
1. The factor f(x) in (26) is assumed to be of the order of unity when its argument is of the order of unity, and is otherwise left unspecified. Finally, we verify in the appendix that the choice of P(z) in equations (24)–(26) ensures the required change in moments
Zn
M
1 to occur precisely at n = 1/g2β2.
At the next step we use the probability density (24) for evaluating the Laplace transform function Gβ(p) in the high-temperature phase. A somewhat lengthy but straightforward calculation reveals that the log-normal tail
gives for M
1 a negligible relative contribution to the Laplace transform, as long as we keep finite the value pZe < ∞. Effectively, it means that for our goals we can assume the partition function Zβ to be distributed with the probability density
given in equation (25). After a simple transformation of variables this implies a rather simple asymptotic formula
Using such an expression, we can, for example, easily calculate the mean logarithm of the partition function, hence the mean free energy
so that the mean free energy is given by
The leading term yields the expected universal REM expression for the mean free energy valid in the high-temperature phase, the rest corresponds to system-specific corrections. Those corrections diverge logarithmically when approaching the critical temperature β = 1/g = βc, signalling of the phase transition. Note that the same result for the free energy can be recovered by the standard replica trick using moments (21).
The fluctuations of the free energy around its mean value can be easily recovered as well, using the explicit form of the distribution
. Namely, introducing
equation (25) implies the following probability density in the high-temperature phase β < βc:
According to our previous discussion, a central role is played by
. Identifying L = ln M we observe that
where
. Using equation (28) we further see that
again in full agreement with CLD results in the high-temperature phase, with c(β) interpreted as the travelling wave velocity, and the wavefront profile given by
3.2. Transition to the low-temperature phase in the circular logarithmic REM
To investigate the low-temperature phase for β ≥ βc we rely upon the CLD freezing scenario. When approaching the transition point a = β2/β2c = 1 the profile (31) tends to a well-defined limit
where K1(x) is the modified Bessel (Macdonald) function. According to the freezing arguments this shape via relation (8) is translated into the extreme-value probability density (2), which is our central result. This expression is non-Gumbel as the cumulative distribution behaves for x → –∞ as
in full agreement with the analysis of [9]. The opposite tail for x → ∞ has a generalized Gumbel-like shape
. Note a certain similarity of these two asymptotes to those of the probability density for the magnetization in the low-temperature phase of the XY model [21].
Moreover, for all temperatures below the transition β ≥ βc the value of the leading term in mL and the shape of the wavefront profile should be frozen to the critical point values, i.e. those for β = βc. Thus, to the leading order mL(β > βc) = c(βc)L ≡ m*L,Note2 whereas the profile gβ(y) is given by equation (32) for any β > βc. In the same way as in the REM case this fact allows one to extract the moments of the partition function everywhere in the low-temperature phase when
. Employing now the critical profile shape equation (32) and substituting
we recover the Laplace transform Gβ(p) of the probability density of the partition function below the transition
This gives us the possibility of calculating negative moments of the partition function as
where we have used the identity [22]
Substituting here the explicit values of γ and b, and changing ν → –ν we finally get
Although we used ν < 0 in the course of derivation, a slight modification of the above procedure, see [3], shows that the above expression is valid in a wider region, as long as ν < βc/β < 1.
The mean value of the free energy F in the low-temperature phase is found in a similar way and the leading order term is simply
F
= –β–1
ln Z
= –m*L. Introducing the probability density
of f = F + m*L we can now rewrite equation (36) as
In particular, similarly to the REM case after an analytic continuation s → is the probability density of the free energy for the circular logarithmic model (CLM) can be extracted for any β > βc by inverting the corresponding Fourier transform. The corresponding formula takes a form of an infinite series
where ψ(x) = Γ '(x)/Γ(x). Exploiting the series expansion for the Macdonald function, see, e.g. p 909 of [22], it is easy to check that in the zero temperature limit β → ∞ the free-energy distribution indeed reduces to the extreme-value probability density of form equation (2) in full agreement with the general relation (8). Equation (39) shows that the same non-Gumbel behaviour holds for the far-left tail f → –∞ of the free-energy distribution at any temperature below the transition.
3.3. Conclusion, discussions and open problems
In the present paper, we attempted to investigate some implications of the CLD freezing scenario [9] for a particular type of REM-like model with logarithmically correlated random potential on a circle. The chosen model seems to be especially attractive due to relatively simple expressions for the integer moments of the partition function in the high-temperature phase, given by the well-known Dyson Coulomb gas integral. We argue that in such a case the Laplace transform of the probability density of the partition function can be efficiently recovered. When combined with the freezing scenario this knowledge allows us to continue the Laplace transform to the low-temperature phase. We first check that the method indeed works for the standard REM example by recovering the well-known, yet nontrivial Gardner–Derrida formulae [3] for the moments of the partition function below the freezing point. The same method is then applied to the logarithmic model in question. In particular, we are able to recover the full distribution of the lowest minimum in the potential, equation (2), and this extreme-value statistics is manifestly non-Gumbel.
Although we think our results are supported by rather convincing arguments, the calculations are very essentially based on a few plausible but not yet fully verified assumptions. As such, mathematically our conclusions have the status of well-grounded conjectures. It would be certainly very desirable to find alternative ways of investigating the model, as well as to perform accurate numerical verification of the precise form of the extreme-value statistics. Another open problem is the universality of our result, equation (2), for logarithmically correlated random variables, in particular the shape of the right tail (see [17]). We hope our results provide enough incentive for further research in this direction.
Finally, it might be useful to provide an alternative view on our choice of the logarithmically correlated potential, equation (15). By employing the known identity:
we see that the covariance function (15) represents, in fact, a 2π-periodic real-valued Gaussian random process
with a self-similar spectrum
characterized by the particular choice of the Hurst exponent H = 0. Such a process therefore represents a version of the so-called 1/f noise. To this end it is worth mentioning that the extreme-value statistics of the `roughness' associated with 1/f noise was investigated in [23], and found to be of Gumbel form.
Acknowledgments
YF acknowledges support of this work by the Leverhulme Research Fellowship project `A single particle in random energy landscapes'. Discussions with M Feigelman S Nechaev V Vargas and V Yudson are acknowledged with thanks.
Appendix.
The positive integer moments of the distribution
, see Equations (24)–(26), are given in the high-temperature phase βg < 1 by the sum of two terms
The first contribution corresponding to equation (25) is given by
In the limit ln M → ∞ we have from (24) and (25)
in view of β2g2 < 1. After a simple calculation we find
As to the second contribution, a saddle-point analysis justified by ln M
1 shows that:
Comparing the two contributions m(n)> and m(n)< within the high-temperature phase βg < 1 we see that
| (1) | m(n)< which implies
|
| (2) | If
which follows from
|
Notes
Yan V Fyodorov and Jean-Philippe Bouchaud 2008 J. Phys. A: Math. Theor. 41 372001
M. W. Auger et al. 2009 ApJ 705 1099
D Grossman et al 2008 New J. Phys. 10 023036
Margareta Wallquist et al 2008 New J. Phys. 10 063005
J. Xavier Prochaska et al 2009 ApJ 705 L113
D K Chambers et al 2008 J. Phys.: Condens. Matter 20 382202
Osame Kinouchi et al 2008 New J. Phys. 10 073020
Eric Gaidos et al 2009 ApJ 705 L163
Chunghee Nam et al 2009 J. Phys. D: Appl. Phys. 42 222002
Ulf Leonhardt 2009 New J. Phys. 11 093040