Abstract
Recently the author used an information theoretical formulation of non-equilibrium statistical mechanics (MaxEnt) to derive the fluctuation theorem (FT) concerning the probability of second law violating phase-space paths. A less rigorous argument leading to the variational principle of maximum entropy production (MEP) was also given. Here a more rigorous and general mathematical derivation of MEP from MaxEnt is presented, and the relationship between MEP and the FT is thereby clarified. Specifically, it is shown that the FT allows a general orthogonality property of maximum information entropy to be extended to entropy production itself, from which MEP then follows. The new derivation highlights MEP and the FT as generic properties of MaxEnt probability distributions involving anti-symmetric constraints, independently of any physical interpretation. Physically, MEP applies to the entropy production of those macroscopic fluxes that are free to vary under the imposed constraints, and corresponds to selection of the most probable macroscopic flux configuration. In special cases MaxEnt also leads to various upper bound transport principles. The relationship between MaxEnt and previous theories of irreversible processes due to Onsager, Prigogine and Ziegler is also clarified in the light of these results.
The constrained maximization of Shannon information entropy (MaxEnt) is an algorithm for constructing probability distributions from partial information, which resides naturally within the framework of Bayesian probability theory [1]. It is a statistical inference tool of considerable generality. In particular, Jaynes [2] has proposed MaxEnt as a universal method for constructing the microscopic probability distributions of equilibrium and non-equilibrium statistical mechanics. Recently the author applied MaxEnt to the information entropy of microscopic phase-space paths, and derived three generic non-equilibrium properties from the resulting MaxEnt path distribution: the fluctuation theorem (FT), maximum entropy production (MEP) and self-organized criticality for slowly flux-driven systems [3]. In this letter we present a more rigorous and general mathematical derivation of MEP from MaxEnt which clarifies the relationship between MEP and the FT. This new derivation of MEP also sheds light on the relationship between MaxEnt and previous theories of irreversible processes due to Onsager [4], Prigogine [5] and Ziegler [6].
Let us begin by recalling some general mathematical properties of MaxEnt distributions which hold irrespective of any physical assumptions [1]. The purpose here is to show that MEP and the FT are generic properties of a certain class of MaxEnt distributions. The physical interpretation of MaxEnt and MEP will be addressed subsequently. We consider a situation with n potential outcomes and m < n constraints in the form of known values Fk of certain functions fk (1 ≤ k ≤ m). We wish to assign Bayesian probabilities pi (1 ≤ i ≤ n) so as to quantify our partial information about the outcomes. In the MaxEnt approach we choose the distribution pi that maximizes the Shannon information entropy

subject to the constraints


fk
, the rationale being that
fk
is the estimator of fk with minimum expected square error [7]. Implicit here is the Bayesian interpretation of pi as a measure of our state of knowledge about the real world rather than an inherent property of the real world (a sampling frequency) [1].
By introducing the vector of Lagrange multipliers (λ1, ..., λm) ≡
and defining the partition function

the MaxEnt distribution is obtained as

where the notation p(i
FC) (the probability of i given F and C) reminds us that pi is conditional on the available information consisting of the constraint vector F ≡ (F1, ..., Fm) together with the prior information C (e.g. microscopic physics in the case of statistical mechanics [8]) that determines the set of allowed outcomes and corresponding function values fk(i). The Lagrange multipliers
may be expressed in terms of the constraints F by solving the relations

leading directly to the reciprocity relations and fluctuation formulae

The maximum value of the information entropy is

The solution of equation (6) for
, when substituted into equation (8), gives Hmax as a function of the constraint vector F alone, a function which will be denoted by S(F). In order to keep the notation simple in the following analysis, we temporarily suppress the dependence of S on the prior information C, although it will be introduced later when required (equation (23)). Equation (8) describes a Legendre transformation between S(F) and log Z(
). By considering small changes in the constraints F, it is straightforward to show that

Equation (9) is a general orthogonality property of MaxEnt distributions. It states that the vector of Lagrange multipliers
is everywhere locally normal to the contours of S in F-space (and points in the direction of decreasing S). Thus
specifies not only the MaxEnt distribution corresponding to a given constraint vector F, but also how S will vary under small changes in the constraints in the neighbourhood of F. Further differentiation of equation (9) gives the reciprocity relations in terms of S as

A and B are symmetric, positive definite matrices. Furthermore A (the entropy curvature matrix) is the inverse of B (the covariance matrix), provided we are dealing with linearly independent constraints (i.e. ∂Fj/∂Fk = δjk).
Next we consider those situations in which the potential outcomes can be grouped in pairs (i+, i–) with respect to which each function fk is anti-symmetric,

Then the MaxEnt distribution satisfies the generic 'fluctuation theorem' (FT)

A variety of relationships of this general form have been derived for stationary and non-stationary physical systems, in terms of the ratio of probabilities of pairs of microscopic phase-space trajectories related by path reversal [9]. It was recognized in [10] that a common explanation for these relationships lies in the hypothesis that the trajectories have a Gibbs-type probability distribution. MaxEnt provides the natural formalism in which Gibbs-type distributions emerge, whether or not they refer to physical systems. Thus the FT is not confined to physical systems alone but arises in a (potentially large) class of statistical inference problems involving constraint functions which are anti-symmetric (sensu equation (11)).
The generic FT (equation (12)) has important implications for the functional form of the relationship between
and F. This may be seen explicitly by expressing the FT in terms of p(f), the p.d.f. of f ≡ (f1, ..., fm),

and invoking the quadratic (steepest descent) approximation to p(f) around f = F,

It is easily verified that equations (13) and (14) are satisfied simultaneously for all f if and only if

which, by inversion, implies

Here we emphasize that, in general, the 'constitutive relations' between
and F described by equations (15) and (16) are nonlinear due to the dependences, respectively, of A on F and B on
.
These consequences of the FT may be re-expressed as gradient properties of the 'dissipation function' (so-called for reasons that will become apparent in equation (27)), defined by

Substitution of Ajk = ∂λj/∂Fk into equation (15) leads straightforwardly to an orthogonality condition in F-space satisfied by the mean dissipation D ≡
d
,

Thus the FT extends the orthogonality property of S (equation (9)) to the mean dissipation function: the vector of Lagrange multipliers
indicates the direction in F-space of steepest descent on the S-surface and of steepest ascent on the mean dissipation surface D(F). In other words, the D-surface is essentially an inverted copy of the S-surface. Similarly, from Bjk = ∂Fj/∂λk and equation (16), we obtain the dual orthogonality condition in λ-space:

The constraint vector F indicates the direction in λ-space of steepest ascent on the dissipation surface D(
). Equations (15) and (16) also yield the relations

where Δ2 ≡
d2
− D2 is the variance of d. As implied by the arguments of A and B, in general D is not a quadratic function of F or
.
As we now show, the orthogonality conditions (equations (18) and (19)) derived from the FT imply that D adopts its maximum value allowed under the imposed constraints. Let us consider equation (19) first. A given set of constraints defines a fixed vector F which, to be specific, we denote by F*. The MaxEnt value of the Lagrange multiplier vector,
*, corresponding to the prescribed F* must then satisfy the orthogonality condition ∂D(
)/∂λk|λ=λ
= 4F*k. This coincides with the value of
that maximizes D(
) subject to the constraint

as may be verified by forming the Lagrangian function

in which γ is a Lagrange multiplier; setting ∂Ψ(
)/∂λk|λ=λ
= 0 reproduces the required orthogonality condition for γ = −2. That this solution is a maximum follows from ∂2Ψ/∂λj∂λk = (1+γ)∂2D/∂λj∂λk = −4Bjk and the positive definiteness of B. Geometrically, the equation 2∑mk=1λkF*k = c defines a plane π(c) in λ-space whose normal lies in the direction of the prescribed F*, while the equation D(
) = c defines a contour of the mean dissipation function in λ-space. Equation (21) then implies that the values of c allowed by the constraints F* are those for which the plane π(c) intersects the contour D(
) = c. From among these allowed values of c the orthogonality condition selects the value c* for which π(c*) intersects the contour D(
) = c* tangentially, at a single point
* corresponding to the maximum allowed value of c.
In contrast to this result, we note that D(
) has a minimum at
* with respect to variations in
which are restricted to the plane π(c*), as may be verified by forming the Lagrangian function

setting ∂Φ(
)/∂λk|λ=λ
= 0 gives the orthogonality condition at
* for γ = −2, and ∂2Φ/∂λj∂λk = ∂2D/∂λj∂λk = 4Bjk implies that this stationary point is a minimum. Anticipating the physical interpretation of D as entropy production (see equation (28)), Prigogine's principle of minimum entropy production [5] may be seen as a special case of this latter type of constrained variation in which one or more components of F* is zero (say, F*k = 0 for 1 ≤ k ≤ s < m). Then within the plane π(c*) the complementary components of
(i.e. λk for s < k ≤ m) are fixed, and D(
) has a minimum with respect to variation in the free components of
(i.e. λk for 1 ≤ k ≤ s). This last statement is in fact somewhat more general than Prigogine's result, because it does not require the usual near-equilibrium assumption of linear constitutive relations.
In the MaxEnt distribution, the information concerning the constraints F is encoded in the vector of Lagrange multipliers
via equation (6). It is then a matter of convenience whether we choose F or
to describe the imposed constraints. By an argument identical to that leading to maximum dissipation in λ-space, the orthogonality condition in F-space (equation (18)) is equivalent to maximizing D(F) subject to the constraint D(F) = 2∑mk=1λ*kFk in which
* is prescribed, the solution being a maximum on account of the positive definiteness of A.
We now consider the less restrictive problem in which the prior information C represents all of the available information, and Fk (1 ≤ k ≤ m) represent free (linearly independent) variables to be determined from C. Here C includes not only the prior information (e.g. microscopic physics) determining the set of allowed outcomes 1 ≤ i ≤ n, but also the conditions of the problem (e.g. steady-state conditions, critical thresholds) determining the set of variables Fk (1 ≤ k ≤ m) that are linearly independent and their domain of allowed values in F-space. We wish to estimate the Fk from knowledge of C alone. A fundamental property of any such estimate, FC, is its redundancy in the sense that knowing both FC and C cannot alter our uncertainty about the outcomes based on knowledge of C alone. We may express this mathematically through the redundancy condition

where S(FCC) and S(C) are the MaxEnt information entropies of the conditional probabilities p(i
FCC) and p(i
C) respectively. The distribution p(i
FCC) is given by equation (5) with F = FC, and we now indicate explicitly the dependence of the corresponding information entropy, S(FCC), on the prior information C. As before, we consider the case where the functions fk are anti-symmetric over the outcomes (sensu equation (11)). In that case a dissipation function D(F) can be defined, as before, through p(i
FC). Suppose now that D(F) has an upper bound Dmax(C) within the domain of F-space compatible with C. It may be shown from the orthogonality property of D(F) established above that the only estimate FC satisfying both the redundancy condition (equation (23)) and the upper bound constraint on D(F) is that for which D(F) attains its upper bound value Dmax(C) (see the appendix). Physically, this result corresponds to MEP (see below). Furthermore, in the special case where C admits only one independent variable F (i.e. m = 1) and where F itself has an upper bound Fmax(C), it may be shown similarly (see the appendix) that the only consistent estimate of F from C is Fmax(C). This latter result corresponds to various maximum flux principles in physics (see below). Other than the existence of the upper bounds Dmax(C) and Fmax(C), these results are independent of the specific nature of the constraint C. The property of maximum dissipation (and maximum flux) is generic to MaxEnt estimates of anti-symmetric functions.
So far we have deliberately avoided any physical interpretation in the derivation of the above results, in order to expose them as generic properties of MaxEnt which apply to a certain class of problems involving statistical inference from partial information. We now ask: if MaxEnt is fundamentally an algorithm of Bayesian statistical inference, why should we expect it to work as a description of nature? The answer is that, in its application to statistical mechanics, MaxEnt predicts that behaviour which is selected reproducibly by nature under the imposed constraints [2, 3]. The latter consist of the applied experimental conditions (constraints F or, equivalently,
) together with the known or hypothesized microscopic physics defining the allowed microstates or phase-space trajectories (prior information C). Evidently, knowledge of FC alone must be sufficient to predict any result that nature reproduces under FC. This is precisely the information from which the MaxEnt distribution p(i
FC) is constructed, and from which all physical observables are predicted through expectation values taken over p(i
FC). In the less restrictive problem of estimating F from C, the redundancy condition of equation (23) is interpreted in physical terms as the requirement that FC is reproducibly selected under C. In statistical terms, reproducible behaviour simply means the most probable behaviour: it is reproducible precisely because it is characteristic of each of the overwhelming majority of microscopic states or paths consistent with the imposed constraints [2, 3].
To summarize, MaxEnt is a statistically based physical selection principle which extends Boltzmann's insight to non-equilibrium systems. It predicts the reproducible (i.e. most probable) behaviour selected under given constraints. However, the predictive success of MaxEnt (like that of equilibrium statistical mechanics) hinges on having correctly identified the constraints that actually apply in nature. In that respect MaxEnt (and hence the principles of maximum dissipation and maximum flux) remains essentially a trial-and-error procedure; its failures inform us of new constraints (new physics).
We now discuss the physical interpretation of the dissipation function D as entropy production. Recently the author applied MaxEnt to the non-equilibrium stationary behaviour of a finite system (volume V, boundary Ω) exchanging energy and matter with its environment [3]. There the possible outcomes consisted of microscopic phase-space paths Γ over a finite time interval τ. The constraints Fk took the general form of initial values (at t = 0) of some scalar density at each point x
V, denoted here by ρ(x, 0), together with the time-averaged values of the outward normal component of the corresponding flux density at each point x
Ω, denoted by
, where the overbar indicates a time average over the interval t
(0, τ). The construction of the MaxEnt path distribution pΓ then proceeded as described above: the sum over k in equation (5) passes over, in the continuum limit, to spatial integrals over V and Ω, giving

where α(x) and η(x) are Lagrange multipliers associated with ρ(x, 0) and
, respectively. Contributions like equation (24) arising from different scalar densities ρ (e.g. internal energy, mass) combine additively. As shown in [3], α(x) on the boundary is related to η(x) through the local continuity equation that applies to each path Γ, ∂ρ(x, t)Γ/∂t = −∇ ⋅ F(x, t)Γ + Q(x, t)Γ, in which Q is a local source; specifically we find η(x) = −τα(x)/2. Therefore the exponent (path action) of the MaxEnt path distribution becomes

The inclusion of the local density constraints ρ(x, 0), embodied in the first term of equation (25), leads to a physical interpretation of the Lagrange multiplier α(x) and hence of the second term in equation (25). Specifically, the requirement that pΓ corresponds to the Gibbs grand-canonical distribution in the equilibrium limit,
, implies α = −1/kBT when ρ is the internal energy density and α = μ/kBT when ρ is the mass density of some chemical species, where T is temperature, μ is the species chemical potential and kB is Boltzmann's constant.
Retaining these identifications, we may consider the MaxEnt distribution constructed from the surface flux constraints alone, whose path action is the second term in equation (25),

The point here is that now all the constraint functions are anti-symmetric (sensu equation (11)): the allowed microscopic paths Γ (whether they are governed by deterministic or stochastic equations of motion) can be grouped in pairs related by path reversal, under which
is anti-symmetric. Therefore maximum dissipation applies as described above. When
is the internal energy flux density (α = −1/kBT), for example, the mean dissipation is

which may be identified with the (dimensionless) thermodynamic entropy exported across Ω during interval τ by heat flow; analogous contributions to D from mass flows across Ω combine additively. In the steady state, equation (27) may also be written as the volume integral

which is the corresponding thermodynamic entropy production within V, the two terms in the integrand representing thermal and frictional dissipation, respectively. In physical terms, therefore, maximum dissipation translates to maximum entropy export, or equivalently in the steady state, maximum entropy production (MEP). Note, however, that stationarity is not a necessary condition for maximum entropy export; in equation (27),
could represent the surface flux at x averaged over a small time interval τ during the (non-stationary) macroscopic evolution of the system.
We illustrate these general results with two physical examples. First, in Rayleigh–Bénard convection a fixed temperature gradient is imposed across a fluid layer enclosed between two horizontal conducting surfaces, corresponding to the case of prescribed
* (inverse temperature gradient). In this one-dimensional problem, MEP then implies that the selected steady-state vertical heat flux across the fluid (F) is given by the maximum value of F allowed under
*; this result may also be seen more directly as an application of the maximum flux principle. An analogous result holds for the momentum flux across a fluid layer subjected to a fixed shear. These upper bound transport principles have been shown to reproduce several key features of the observed vertical profiles of temperature and velocity in steady-state thermal and shear turbulence [11]. Alternatively, imposing a fixed heat input (prescribed F*) leads to selection of the maximum (inverse) temperature gradient (
) allowed by F*.
Secondly, within a simple 10-box zonal model of Earth's climate, Paltridge [12] showed that MEP reproduces the observed zonal distributions of meridional heat transport, surface temperature and cloud fraction with remarkable accuracy. This application corresponds to the less restrictive problem where the variables Fk (horizontal heat flux between boxes k and k + 1) and λk (inverse temperature gradient between boxes k and k + 1) are free variables to be selected by the imposed constraints C (steady-state energy balance under prescribed solar radiation inputs at the top of the atmosphere). Paltridge's analysis also included the supplementary hypothesis that within each zone the surface-to-atmosphere convective transport of sensible and latent heat is maximal for a given configuration of horizontal heat fluxes Fk in the atmosphere and oceans. This additional 'convection hypothesis'—which predicts the homeostatic regulation of surface temperature by clouds [13]—is another example of the maximum flux principle obtained here from MaxEnt, in which it is assumed that adjustment of vertical convection occurs over a much shorter timescale than adjustment of the Fk. These and other applications of MEP are discussed in [14]. Except in the simplest cases, most physical applications of MEP correspond to the less restrictive problem of variable F and
rather than prescribed F* or
*.
The present derivation of MEP from MaxEnt refines and generalizes the less rigorous argument advanced previously [3]. It demonstrates explicitly the relationship between MEP and the FT via the orthogonality property of the dissipation function D, and furthermore shows how MEP, the FT and orthogonality of D are generic properties of MaxEnt distributions under anti-symmetric constraints. It also makes clear that in physical applications MEP applies to the entropy production of those linearly independent fluxes that are free to vary under the imposed constraints.
Finally, we comment briefly on the relationship between MaxEnt and previous theories of irreversible processes due to Onsager [4], Prigogine [5] and Ziegler [6]. Jaynes [1, 2] already noted that Onsager-type reciprocity relations (equation (7)) emerge naturally as generic properties of MaxEnt distributions, independently of any underlying physical assumptions. In addition, Županović et al [15] showed recently for the case of linear flux–force relationships that MEP is equivalent to the Onsager–Rayleigh principle of 'least dissipation of energy' (despite the name), and that MEP manifests itself as Kirchoff's loop law in linear electric networks and their analogues in chemical reaction networks [16]. In this work, the constitutive relations between F and
derived from the FT (equations (15) and (16)) provide nonlinear generalizations of Onsager's linear flux–force relations, and imply that the Onsager–Rayleigh principle (MEP) may be extended to systems far from equilibrium.
As noted after equation (22), Prigogine's principle of minimum entropy production [5] can be interpreted within the MaxEnt formalism as a special case of the behaviour of the dissipation function D(
) under variations in
that are restricted to the plane π(c*). Maximum dissipation is a more general result which describes the behaviour of D(
) under all possible variations in
permitted by the imposed constraints and thus represents a physical selection principle under given constraints. MEP applies both close to and far from equilibrium.
In Ziegler's formalism [6], a dissipation function Φ = ΣkAk(d)vk was defined in terms of dissipative forces Ak(d) and corresponding velocities vk, with Φ being considered the fundamental quantity from which the dissipative forces were to be derived. Assuming Φ is given as a function of the vk alone, Ziegler derived the orthogonality condition Ak(d) ∝ ∂Φ/∂vk on the grounds that it is the only possible vectorial relation between Ak(d) and Φ. Then the principle of maximum dissipation followed as above. Ziegler's formalism is discussed further in the context of Earth's climate in [13]. MaxEnt provides a more fundamental statistical basis for the orthogonality condition. In MaxEnt the fundamental quantity is not the dissipation function D but the information entropy H, from whose maximization D emerges as a derived quantity. Via the FT, MaxEnt establishes MEP as a physical selection principle for the most probable configuration of macroscopic fluxes under given constraints.
Acknowledgments
I thank Alan McKane and an anonymous referee for valuable comments on the submitted manuscript. I am grateful to Davor Juretić and Pasko Županović for many stimulating discussions and access to their preprints. This work was supported by the French Département Environnement et Agronomie, INRA.
Appendix. Maximum dissipation and maximum flux principles under arbitrary constraints
Given the prior information C, let there be m linearly independent unknowns Fk (1 ≤ k ≤ m). We wish to estimate the values of Fk from knowledge of C alone. This estimate, denoted by FC, must satisfy the redundancy condition, equation (23), as well as the upper bound constraint on the dissipation function, D(F) ≤ Dmax(C), within the domain of F-space compatible with C. The nature of the constraint C is otherwise arbitrary. The distribution p(i
C) from which FC is to be estimated is obtained from MaxEnt by maximizing the information entropy

subject to the three constraints



FCC), and the estimate FC is to be recovered from p(i
C) in the usual way (equation (2)),

Inequality constraints like equation (A.3) can be incorporated into MaxEnt in a similar way to equality constraints [17]. We introduce the Lagrangian function

in which α, β and γ are Lagrange multipliers. The only difference with regard to treatment of the inequality constraint on
D
is that now we have two possibilities: either β = 0 and
D
is strictly less than Dmax(C) (the constraint is inactive) or β ≠ 0 and
D
= Dmax(C) (the constraint is active, i.e. maximum dissipation). Setting ∂ψ/∂p(i
C) = 0 yields the solution

in which λk arises from differentiating S(FCC) with respect to Fk as in equation (9), and the partition function Z(α, β) is a normalization factor arising from equation (A.4).
For the case β = 0 (constraint on
D
inactive), we have

Comparing equation (A.8) with equation (5), we see that in this case p(i
C) coincides with the MaxEnt distribution
specified by the Lagrange multiplier
, and its information entropy is therefore given by
. As established in the main text, the value
=
(FC) maximizes the dissipation function D(
) subject to the constraint D(
) = 2
⋅ FC, and consequently
for any finite α. Because the D-surface is essentially an inverted copy of the S-surface (see the main text), this last inequality implies that
in violation of the redundancy condition (equation (A.2)). The case β = 0 is thereby excluded.
The redundancy condition can only be satisfied when β ≠ 0, i.e. the inequality constraint must be a strict equality:
D
= Dmax(C). In many practical applications (e.g. physical systems with a large number of microscopic degrees of freedom) we can ignore fluctuations in f around its mean value FC (i.e.
D
= D(FC)), and we therefore have D(FC) = Dmax(C). The MaxEnt estimate of F from the constraint C then coincides with the value of F that maximizes the dissipation function under C.
In the special case where C admits only one unknown F and where F itself has an upper bound Fmax(C), the same analysis with equation (A.3) replaced by

shows that the only estimate of F from C satisfying both the redundancy condition (equation (A.2)) and the upper bound constraint on F is F = Fmax(C). In physical applications this result corresponds to various maximum flux principles (see the main text).
References
- [1]Jaynes E T 2003 Probability Theory: the Logic of Science ed G L Bretthorst (Cambridge: Cambridge University Press)
- [2]Jaynes E T 1957 Phys. Rev. 106 620
- Jaynes E T 1957 Phys. Rev. 108 171
- Jaynes E T 1979 The Maximum Entropy Principle ed R D Levine and M Tribus (Cambridge, MA: MIT Press) p 15
- Jaynes E T 1980 Ann. Rev. Phys. Chem. 31 579
- [3]Dewar R C 2003 J. Phys. A: Math. Gen. 36 631
- Dewar R C 2004 Non-Equilibrium Thermodynamics and the Production of Entropy ed A Kleidon and R Lorenz (Berlin: Springer) p 41
- [4]Onsager L 1931 Phys. Rev. 37 237
- Onsager L 1931 Phys. Rev. 37 2265
- [5]Prigogine I 1962 Introduction to Non-Equilibrium Thermodynamics (New York: Wiley-Interscience)
- [6]Ziegler H 1983 An Introduction to Thermomechanics (Amsterdam: North-Holland)
- [7]Jaynes E T 1985 Maximum-Entropy and Bayesian Methods in Inverse Problems ed C R Smith and W T Grandy (Dordrecht: Reidel) p 21
- [8]Evans R M L 2005 J. Phys. A: Math. Gen. 38 293
- [9]Evans D J and Searles D J 2002 Adv. Phys. 51 1529
- [10]Maes C 1999 J. Stat. Phys. 95 333
- [11]Kerswell R R 2002 J. Fluid Mech. 461 239 and references therein
- [12]Paltridge G W 1978 Q. J. Met. Soc. 104 927
- [13]O'Brien D M and Stephens G L 1995 Q. J. Met. Soc. 121 1773
- [14]Ozawa H, Ohmura A, Lorenz R D and Pujol T 2003 Rev. Geophys. 41 1018
- Kleidon A and Lorenz R (ed) 2004 Non-Equilibrium Thermodynamics and the Production of Entropy (Berlin: Springer)
- [15]Županović P, Juretić D and Botrić S 2005 Fizika A at press
- [16]Županović P, Juretić D and Botrić S 2004 Phys. Rev. E 70 056108
- Županović P and Juretić D 2004 Croat. Chem. Acta 77 561
- [17]Ishwar P and Moulin P 2003 IEEE Trans. Signal Process. 51 698
Citations
-
Complexity and organization in hydrology: A personal view
Rafael L. Bras Water Resources Research 2015 51 6532 - Dmitry S. Shalymov and Alexander L. Fradkov 2015 434
-
Communication: Maximum caliber is a general variational principle for nonequilibrium statistical mechanics
Michael J. Hazoglou et al The Journal of Chemical Physics 2015 143 051104 -
Field comparison of methods for estimating groundwater discharge by evaporation and evapotranspiration in an arid-zone playa
Margaret Shanafield et al Journal of Hydrology 2015 -
Land surface energy partitioning revisited: A novel approach based on single depth soil measurement
Jiachuan Yang and Zhi-Hua Wang Geophysical Research Letters 2014 41 8348 -
Thermodynamic entropy fluxes reflect ecosystem characteristics and succession
Henry Lin Ecological Modelling 2014 -
Small Open Chemical Systems Theory: Its Implications to Darwinian Evolution Dynamics, Complex Self-Organization and Beyond
Qian Hong Communications in Theoretical Physics 2014 62 550 -
Entropy Production Rate of Non-equilibrium Systems from the Fokker-Planck Equation
Yu Haitao and Du Jiulin Brazilian Journal of Physics 2014 -
A model of energy budgets over water, snow, and ice surfaces
Jingfeng Wang et al Journal of Geophysical Research: Atmospheres 2014 n/a -
Thermodynamic extremization principles and their relevance to ecology
Jian D. L. Yen et al Austral Ecology 2014 n/a -
Entropy production and coarse graining of the climate fields in a general circulation model
Valerio Lucarini and Salvatore Pascale Climate Dynamics 2014 -
Morphological assessment with the maximum entropy production rate (MEPR) postulate
Yaw D Bensah and JA Sekhar Current Opinion in Chemical Engineering 2014 3 91 -
An empirical evaluation of four variants of a universal species–area relationship
Daniel J. McGlinn et al PeerJ 2013 1 e212 -
An investigation into the Maximum Entropy Production Principle in chaotic Rayleigh-Bénard convection
R.A.W. Bradford Physica A: Statistical Mechanics and its Applications 2013 -
Principles of maximum entropy and maximum caliber in statistical physics
Steve Pressé et al Reviews of Modern Physics 2013 85 1115 -
Nonequilibrium thermodynamics of circulation regimes in optically-thin, dry atmospheres
Salvatore Pascale et al Planetary and Space Science 2013 -
Causal Entropic Forces
A. D. Wissner-Gross and C. E. Freer Physical Review Letters 2013 110 -
SOLUTION OF POPULATION BALANCE EQUATIONS IN EMULSION POLYMERIZATION USING METHOD OF MOMENTS
Ehsan Vafa et al Chemical Engineering Communications 2013 200 20 -
Modified saddle-point integral near a singularity for the large deviation function
Jae Sung Lee et al Journal of Statistical Mechanics: Theory and Experiment 2013 2013 P11002 -
Electric diffusion in cylindrical conductors from extended irreversible thermodynamics perspective
F.E.M. Silveira Physica A: Statistical Mechanics and its Applications 2012 -
Natural selection. V. How to read the fundamental equations of evolutionary change in terms of information theory
S. A. Frank Journal of Evolutionary Biology 2012 25 2377 -
Entropy and ionic conductivity
Yong-Jun Zhang Physica A: Statistical Mechanics and its Applications 2012 -
Maximum-entropy closure for a Galerkin model of an incompressible periodic wake
Bernd R. Noack and Robert K. Niven Journal of Fluid Mechanics 2012 1 -
Entropy production and viscosity of a dilute gas
Yong-Jun Zhang Physica A Statistical Mechanics and its Applications 2012 -
Planetary Atmospheres as Nonequilibrium Condensed Matter
J.B. Marston Annual Review of Condensed Matter Physics 2012 3 285 -
A thermodynamic framework for constitutive modeling of time- and rate-dependent materials. Part I: Theory
Rashid K. Abu Al-Rub and Masoud K. Darabi International Journal of Plasticity 2012 -
On Intelligence From First Principles: Guidelines for Inquiry Into the Hypothesis of Physical Intelligence (PI)
Michael T. Turvey and Claudia Carello Ecological Psychology 2012 24 3 -
Coupling diffusion and maximum entropy models to estimate thermal inertia
Grey S. Nearing et al Remote Sensing of Environment 2012 119 222 -
How does the Earth system generate and maintain thermodynamic disequilibrium and what does it imply for the future of the planet?
A. Kleidon Philosophical Transactions of The Royal Society A Mathematical Physical and Engineering Sciences 2012 370 1012 -
Extreme Energy Dissipation
Adam Moroz 2012 1 -
Fractal variability: An emergent property of complex dissipative systems
Andrew J. E. Seely and Peter Macklem Chaos An Interdisciplinary Journal of Nonlinear Science 2012 22 013108 -
Comparison of entropy production rates in two different types of self-organized flows: Bénard convection and zonal flow
Y. Kawazura and Z. Yoshida Physics of Plasmas 2012 19 012305 -
A model of evapotranspiration based on the theory of maximum entropy production
Jingfeng Wang and R. L. Bras Water Resources Research 2011 47 W03521 -
A parametric sensitivity study of entropy production and kinetic energy dissipation using the FAMOUS AOGCM
Salvatore Pascale et al Climate Dynamics 2011 -
A Journey from Science through Systems Science in Pursuit of Change
Stanley N. Salthe World Futures 2011 67 282 -
On the variational framework employing optimal control for biochemical thermodynamics
Adam Moroz and David Ian Wimpenny Chemical Physics 2011 380 77 -
Statistics of multifractal processes using the maximum entropy method
V. Nieves et al Geophysical Research Letters 2011 38 L17405 -
Entropy production and thermal conductivity of a dilute gas
Yong-Jun Zhang Physica A Statistical Mechanics and its Applications 2011 390 1602 -
Charged Brownian particles: Kramers and Smoluchowski equations and the hydrothermodynamical picture
R.E. Lagos and Tania P. Simões Physica A Statistical Mechanics and its Applications 2011 390 1591 -
Information flow and information production in a population system
S. Nicolis Physical Review E 2011 84 011110 -
Uncertainties have a meaning: Information entropy as a quality measure for 3-D geological models
J. Florian Wellmann and Klaus Regenauer-Lieb Tectonophysics 2011 -
Present and Last Glacial Maximum climates as states of maximum entropy production
Corentin Herbert et al Quarterly Journal of the Royal Meteorological Society 2011 n/a -
Comment on an information theoretic approach to the study of non-equilibrium steady states
Glenn C Paquette Journal of Physics A: Mathematical and Theoretical 2011 44 368001 -
Powerless fluxes and forces, and change of scale in irreversible thermodynamics
M Ostoja-Starzewski and A Zubelewicz Journal of Physics A: Mathematical and Theoretical 2011 44 335002 -
Non-equilibrium steady states: maximization of the Shannon entropy associated with the distribution of dynamical trajectories in the presence of constraints
Cécile Monthus Journal of Statistical Mechanics: Theory and Experiment 2011 2011 P03008 -
Large-deviation principles, stochastic effective actions, path entropies, and the structure and meaning of thermodynamic descriptions
Eric Smith Reports on Progress in Physics 2011 74 046601 -
Simultaneous extrema in the entropy production for steady-state fluid flow in parallel pipes
Robert K. Niven Journal of Non-Equilibrium Thermodynamics 2010 35 347 -
Selection Is Entailed by Self-Organization and Natural Selection Is a Special Case
Rod Swenson Biological Theory 2010 5 167 -
Ecosystem biogeochemistry considered as a distributed metabolic network ordered by maximum entropy production
J. J. Vallino Philosophical Transactions of The Royal Society B Biological Sciences 2010 365 1417 -
Minimization of a free-energy-like potential for non-equilibrium flow systems at steady state
R. K. Niven Philosophical Transactions of The Royal Society B Biological Sciences 2010 365 1323 -
Maximum Entropy Distributions of Scale-Invariant Processes
Veronica Nieves et al Physical Review Letters 2010 105 118701 -
From molecules to meteorology via turbulent scale invariance
A. F. Tuck Quarterly Journal of the Royal Meteorological Society 2010 n/a -
Stability, complexity and the maximum dissipation conjecture
C. Nicolis and G. Nicolis Quarterly Journal of the Royal Meteorological Society 2010 n/a -
Inferential closed-loop control of particle size and molecular weight distribution in emulsion polymerization of styrene
Ehsan Vafa et al Polymer Engineering and Science 2010 n/a -
Maximum or minimum entropy production? How to select a necessary criterion of stability for a dissipative fluid or plasma
A. Di Vita Physical Review E 2010 81 041137 -
MEP and planetary climates: insights from a two-box climate model containing atmospheric dynamics
T. E. Jupp and P. M. Cox Philosophical Transactions of The Royal Society B Biological Sciences 2010 365 1355 -
Maximum entropy production and plant optimization theories
R. C. Dewar Philosophical Transactions of The Royal Society B Biological Sciences 2010 365 1429 -
Bacterial chemotaxis and entropy production
P. Zupanovic et al Philosophical Transactions of The Royal Society B Biological Sciences 2010 365 1397 -
Maximum entropy production in environmental and ecological systems
A. Kleidon et al Philosophical Transactions of The Royal Society B Biological Sciences 2010 365 1297 -
The maximum entropy production principle: two basic questions
L. M. Martyushev Philosophical Transactions of The Royal Society B Biological Sciences 2010 365 1333 -
A basic introduction to the thermodynamics of the Earth system far from equilibrium and maximum entropy production
A. Kleidon Philosophical Transactions of The Royal Society B Biological Sciences 2010 365 1303 -
A New Statistical Dynamic Analysis of Ecosystem Patterns
Xin Zhang and Li-He Chai Environmental Modeling & Assessment 2010 -
Thermodynamic analysis of snowball Earth hysteresis experiment: Efficiency, entropy production and irreversibility
Valerio Lucarini et al Quarterly Journal of the Royal Meteorological Society 2010 n/a -
Non-equilibrium thermodynamics, maximum entropy production and Earth-system evolution
A. Kleidon Philosophical Transactions of The Royal Society A Mathematical Physical and Engineering Sciences 2010 368 181 -
The mechanics of granitoid systems and maximum entropy production rates
B. E. Hobbs and A. Ord Philosophical Transactions of The Royal Society A Mathematical Physical and Engineering Sciences 2010 368 53 - Yi Chen et al 2010 3928
-
Nonequilibrium thermodynamics modeling of coupled biochemical cycles in living cells
Yaşar Demirel Journal of Non-Newtonian Fluid Mechanics 2010 165 953 -
Cooperative and collective effects in light of the maximum energy dissipation principle
Adam Moroz Physics Letters A 2010 374 2005 -
Modularity and Dissipation in Evolution of Macromolecular Structures, Functions, and Networks
Gustavo Caetano-Anollés et al 2010 431 -
The Fourth Law of Thermodynamics: The Law of Maximum Entropy Production (LMEP) : An Interview with Rod Swenson
Mayo Martínez-Kahn and León Martínez-Castilla Ecological Psychology 2010 22 69 -
Life, hierarchy, and the thermodynamic machinery of planet Earth
Axel Kleidon Physics of Life Reviews 2010 7 424 -
Integral biomathics: A post-Newtonian view into the logos of bios
Plamen L. Simeonov Progress in Biophysics and Molecular Biology 2010 102 85 -
Nonequilibrium statistical mechanics of shear flow: invariant quantities and current relations
A Baule and R M L Evans Journal of Statistical Mechanics: Theory and Experiment 2010 2010 P03030 -
Applications of the principle of maximum entropy: from physics to ecology
Jayanth R Banavar et al Journal of Physics: Condensed Matter 2010 22 063101 -
Thermodynamic efficiency and entropy production in the climate system
Valerio Lucarini Physical Review E 2009 80 021118 -
Inferring species interactions in tropical forests
I. Volkov et al Proceedings of the National Academy of Sciences 2009 106 13854 -
Steady state of a dissipative flow-controlled system and the maximum entropy production principle
Robert K. Niven Physical Review E 2009 80 021113 -
Energy flows in complex ecological systems: a review
Jiang Zhang Journal of Systems Science and Complexity 2009 22 345 -
A competitive coexistence principle?
Cathy Neill et al Oikos 2009 -
Entropy of continuous Markov processes in local thermal equilibrium
Miguel Hoyuelos Physical Review E 2009 79 051123 -
How to Cope with Climate’s Complexity?
Michel Crucifix European Review 2009 17 371 -
Nonequilibrium thermodynamics and maximum entropy production in the Earth system
Axel Kleidon Naturwissenschaften 2009 -
A model of surface heat fluxes based on the theory of maximum entropy production
J. Wang and Rafael L. Bras Water Resources Research 2009 45 n/a -
Stochastic dynamics and non-equilibrium thermodynamics of a bistable chemical system: the Schlogl model revisited
M. Vellela and H. Qian Journal of The Royal Society Interface 2009 6 925 -
On the problem of the metastable region at morphological instability
L.M. Martyushev and E.A. Chervontseva Physics Letters A 2009 373 4206 -
Exact thermodynamic principles for dynamic order existence and evolution in chaos
Shripad P. Mahulikar and Heinz Herwig Chaos Solitons & Fractals 2009 41 1939 -
Nonlinear quantum evolution equations to model irreversible adiabatic relaxation with maximal entropy production and other nonunitary processes
Beretta, Gian Paolo Reports on Mathematical Physics 2009 64 139 -
On the extreme of internal entropy production
Jiangnan Li Journal of Physics A: Mathematical and Theoretical 2009 42 035002 -
MAXIMUM ENTROPY AND THE STATE-VARIABLE APPROACH TO MACROECOLOGY
J. Harte et al Ecology 2008 89 2700 -
Visions of Evolution: Self-organization Proposes What Natural Selection Disposes
Stanley Salthe et al Biological Theory 2008 3 17 -
The System of Interpretance, Naturalizing Meaning as Finality
Stanley N. Salthe Biosemiotics 2008 -
Maximum Caliber: A variational approach applied to two-state dynamics
Kingshuk Ghosh et al The Journal of Chemical Physics 2008 128 194102 -
Properties of a nonequilibrium heat bath
R. M. L. Evans et al Physical Review E 2008 77 031117 -
Maximum Entropy Approach for Deducing Amino Acid Interactions in Proteins
Jayanth R. Banavar et al Physical Review Letters 2008 100 078102 -
Quantum-classical correspondence principles for locally nonequilibrium driven systems
Eric Smith Physical Review E 2008 77 021109 -
Daisyworld: A review
Hywel T. P. Williams et al Reviews of Geophysics 2008 46 RG1001 -
Spinodal decomposition of binary mixtures with composition-dependent heat conductivities
Dafne Molin and Roberto Mauri Chemical Engineering Science 2008 63 2402 -
On a variational formulation of the maximum energy dissipation principle for non-equilibrium chemical thermodynamics
Adam Moroz Chemical Physics Letters 2008 457 448 -
Thermodynamics of natural selection I: Energy flow and the limits on organization
Eric Smith Journal of Theoretical Biology 2008 252 185 -
A maximum hypothesis of transpiration
Manuel Lerdau et al Journal of Geophysical Research 2007 112 G03010 -
Maximum entropy production, cloud feedback, and climate change
Graham D. Farquhar et al Geophysical Research Letters 2007 34 L14708 -
Thermodynamics of irreversible transitions in the oceanic general circulation
Shinya Shimokawa and Hisashi Ozawa Geophysical Research Letters 2007 34 L12606 -
THEORY OF TRANSPORT PROCESSES AND THE METHOD OF THE NONEQUILIBRIUM STATISTICAL OPERATOR
A. L. KUZEMSKY International Journal of Modern Physics B 2007 21 2821 -
Natural selection in chemical evolution
Chrisantha Fernando and Jonathan Rowe Journal of Theoretical Biology 2007 247 152 -
Comments on a derivation and application of the 'maximum entropy production' principle
G Grinstein and R Linsker Journal of Physics A: Mathematical and Theoretical 2007 40 9717 -
A discussion on maximum entropy production and information theory
Stijn Bruers Journal of Physics A: Mathematical and Theoretical 2007 40 7441 -
Effect of Drought on Water Relations, Growth and Solute Accumulation in Two Sesame Cultivars
F. Fazeli . et al Pakistan Journal of Biological Sciences 2006 9 1829 -
Maximum entropy production and the strength of boundary layer exchange in an atmospheric general circulation model
Edilbert Kirk et al Geophysical Research Letters 2006 33 L06706 -
Entropy-based member selection in a GCM ensemble forecasting
F. J. Tapiador and C. Gallardo Geophysical Research Letters 2006 33 L02804 -
Quantifying the biologically possible range of steady-state soil and surface climates with climate model simulations
Axel Kleidon Biologia 2006 61 S234 -
Using the principle of entropy maximization to infer genetic interaction networks from gene expression patterns
T. R. Lezon et al Proceedings of the National Academy of Sciences 2006 103 19033 -
Why is planet Earth so habitable?
A. Kleidon Geochimica et Cosmochimica Acta 2006 70 A323 -
The functional design of the rotary enzyme ATP synthase is consistent with maximum entropy production
R.C. Dewar et al Chemical Physics Letters 2006 430 177 -
Maximum entropy production principle in physics, chemistry and biology
L.M. Martyushev and V.D. Seleznev Physics Reports 2006 426 1 -
Equipartition of current in parallel conductors on cooling through the superconducting transition
S Sarangi et al Journal of Physics: Condensed Matter 2006 18 L143 -
Application of the maximum entropy production principle to electrical systems
Thomas Christen Journal of Physics D: Applied Physics 2006 39 4497 -
Complex systems: Order out of chaos
John Whitfield Nature 2005 436 905