LETTER TO THE EDITOR

Maximum entropy production and the fluctuation theorem

2005 IOP Publishing Ltd , ,

Abstract

Recently the author used an information theoretical formulation of non-equilibrium statistical mechanics (MaxEnt) to derive the fluctuation theorem (FT) concerning the probability of second law violating phase-space paths. A less rigorous argument leading to the variational principle of maximum entropy production (MEP) was also given. Here a more rigorous and general mathematical derivation of MEP from MaxEnt is presented, and the relationship between MEP and the FT is thereby clarified. Specifically, it is shown that the FT allows a general orthogonality property of maximum information entropy to be extended to entropy production itself, from which MEP then follows. The new derivation highlights MEP and the FT as generic properties of MaxEnt probability distributions involving anti-symmetric constraints, independently of any physical interpretation. Physically, MEP applies to the entropy production of those macroscopic fluxes that are free to vary under the imposed constraints, and corresponds to selection of the most probable macroscopic flux configuration. In special cases MaxEnt also leads to various upper bound transport principles. The relationship between MaxEnt and previous theories of irreversible processes due to Onsager, Prigogine and Ziegler is also clarified in the light of these results.

The constrained maximization of Shannon information entropy (MaxEnt) is an algorithm for constructing probability distributions from partial information, which resides naturally within the framework of Bayesian probability theory [1]. It is a statistical inference tool of considerable generality. In particular, Jaynes [2] has proposed MaxEnt as a universal method for constructing the microscopic probability distributions of equilibrium and non-equilibrium statistical mechanics. Recently the author applied MaxEnt to the information entropy of microscopic phase-space paths, and derived three generic non-equilibrium properties from the resulting MaxEnt path distribution: the fluctuation theorem (FT), maximum entropy production (MEP) and self-organized criticality for slowly flux-driven systems [3]. In this letter we present a more rigorous and general mathematical derivation of MEP from MaxEnt which clarifies the relationship between MEP and the FT. This new derivation of MEP also sheds light on the relationship between MaxEnt and previous theories of irreversible processes due to Onsager [4], Prigogine [5] and Ziegler [6].

Let us begin by recalling some general mathematical properties of MaxEnt distributions which hold irrespective of any physical assumptions [1]. The purpose here is to show that MEP and the FT are generic properties of a certain class of MaxEnt distributions. The physical interpretation of MaxEnt and MEP will be addressed subsequently. We consider a situation with n potential outcomes and m < n constraints in the form of known values Fk of certain functions fk (1 ≤ km). We wish to assign Bayesian probabilities pi (1 ≤ in) so as to quantify our partial information about the outcomes. In the MaxEnt approach we choose the distribution pi that maximizes the Shannon information entropy

Equation (1)

subject to the constraints

Equation (2)
Equation (3)
This procedure gives the least-biased probability distribution consistent with the available information (i.e. the m constraints, the n outcomes and the mn values fk(i)) because, by construction, pi contains this information alone. Equation (2) does not mean that the constraints Fk must take the form of sample averages (although this case is not excluded); Fk can be any data whatsoever, including single measurements. Equation (2) simply means that pi must agree with the available data in the sense that Fk is recoverable from pi as the expectation value langfkrang, the rationale being that langfkrang is the estimator of fk with minimum expected square error [7]. Implicit here is the Bayesian interpretation of pi as a measure of our state of knowledge about the real world rather than an inherent property of the real world (a sampling frequency) [1].

By introducing the vector of Lagrange multipliers (λ1, ..., λm) ≡ bold epsilon and defining the partition function

Equation (4)

the MaxEnt distribution is obtained as

Equation (5)

where the notation p(i mid FC) (the probability of i given F and C) reminds us that pi is conditional on the available information consisting of the constraint vector F ≡ (F1, ..., Fm) together with the prior information C (e.g. microscopic physics in the case of statistical mechanics [8]) that determines the set of allowed outcomes and corresponding function values fk(i). The Lagrange multipliers bold epsilon may be expressed in terms of the constraints F by solving the relations

Equation (6)

leading directly to the reciprocity relations and fluctuation formulae

Equation (7)

The maximum value of the information entropy is

Equation (8)

The solution of equation (6) for bold epsilon, when substituted into equation (8), gives Hmax as a function of the constraint vector F alone, a function which will be denoted by S(F). In order to keep the notation simple in the following analysis, we temporarily suppress the dependence of S on the prior information C, although it will be introduced later when required (equation (23)). Equation (8) describes a Legendre transformation between S(F) and log Z(bold epsilon). By considering small changes in the constraints F, it is straightforward to show that

Equation (9)

Equation (9) is a general orthogonality property of MaxEnt distributions. It states that the vector of Lagrange multipliers bold epsilon is everywhere locally normal to the contours of S in F-space (and points in the direction of decreasing S). Thus bold epsilon specifies not only the MaxEnt distribution corresponding to a given constraint vector F, but also how S will vary under small changes in the constraints in the neighbourhood of F. Further differentiation of equation (9) gives the reciprocity relations in terms of S as

Equation (10)

A and B are symmetric, positive definite matrices. Furthermore A (the entropy curvature matrix) is the inverse of B (the covariance matrix), provided we are dealing with linearly independent constraints (i.e. ∂Fj/∂Fk = δjk).

Next we consider those situations in which the potential outcomes can be grouped in pairs (i+, i–) with respect to which each function fk is anti-symmetric,

Equation (11)

Then the MaxEnt distribution satisfies the generic 'fluctuation theorem' (FT)

Equation (12)

A variety of relationships of this general form have been derived for stationary and non-stationary physical systems, in terms of the ratio of probabilities of pairs of microscopic phase-space trajectories related by path reversal [9]. It was recognized in [10] that a common explanation for these relationships lies in the hypothesis that the trajectories have a Gibbs-type probability distribution. MaxEnt provides the natural formalism in which Gibbs-type distributions emerge, whether or not they refer to physical systems. Thus the FT is not confined to physical systems alone but arises in a (potentially large) class of statistical inference problems involving constraint functions which are anti-symmetric (sensu equation (11)).

The generic FT (equation (12)) has important implications for the functional form of the relationship between bold epsilon and F. This may be seen explicitly by expressing the FT in terms of p(f), the p.d.f. of f ≡ (f1, ..., fm),

Equation (13)

and invoking the quadratic (steepest descent) approximation to p(f) around f = F,

Equation (14)

It is easily verified that equations (13) and (14) are satisfied simultaneously for all f if and only if

Equation (15)

which, by inversion, implies

Equation (16)

Here we emphasize that, in general, the 'constitutive relations' between bold epsilon and F described by equations (15) and (16) are nonlinear due to the dependences, respectively, of A on F and B on bold epsilon.

These consequences of the FT may be re-expressed as gradient properties of the 'dissipation function' (so-called for reasons that will become apparent in equation (27)), defined by

Equation (17)

Substitution of Ajk = ∂λj/∂Fk into equation (15) leads straightforwardly to an orthogonality condition in F-space satisfied by the mean dissipation Dlangdrang,

Equation (18)

Thus the FT extends the orthogonality property of S (equation (9)) to the mean dissipation function: the vector of Lagrange multipliers bold epsilon indicates the direction in F-space of steepest descent on the S-surface and of steepest ascent on the mean dissipation surface D(F). In other words, the D-surface is essentially an inverted copy of the S-surface. Similarly, from Bjk = ∂Fj/∂λk and equation (16), we obtain the dual orthogonality condition in λ-space:

Equation (19)

The constraint vector F indicates the direction in λ-space of steepest ascent on the dissipation surface D(bold epsilon). Equations (15) and (16) also yield the relations

Equation (20)

where Δ2langd2rangD2 is the variance of d. As implied by the arguments of A and B, in general D is not a quadratic function of F or bold epsilon.

As we now show, the orthogonality conditions (equations (18) and (19)) derived from the FT imply that D adopts its maximum value allowed under the imposed constraints. Let us consider equation (19) first. A given set of constraints defines a fixed vector F which, to be specific, we denote by F*. The MaxEnt value of the Lagrange multiplier vector, bold epsilon*, corresponding to the prescribed F* must then satisfy the orthogonality condition ∂D(bold epsilon)/∂λk|λ=λlowast = 4F*k. This coincides with the value of bold epsilon that maximizes D(bold epsilon) subject to the constraint

Equation (21)

as may be verified by forming the Lagrangian function

Equation (22)

in which γ is a Lagrange multiplier; setting ∂Ψ(bold epsilon)/∂λk|λ=λlowast = 0 reproduces the required orthogonality condition for γ = −2. That this solution is a maximum follows from ∂2Ψ/∂λj∂λk = (1+γ)∂2D/∂λj∂λk = −4Bjk and the positive definiteness of B. Geometrically, the equation 2∑mk=1λkF*k = c defines a plane π(c) in λ-space whose normal lies in the direction of the prescribed F*, while the equation D(bold epsilon) = c defines a contour of the mean dissipation function in λ-space. Equation (21) then implies that the values of c allowed by the constraints F* are those for which the plane π(c) intersects the contour D(bold epsilon) = c. From among these allowed values of c the orthogonality condition selects the value c* for which π(c*) intersects the contour D(bold epsilon) = c* tangentially, at a single point bold epsilon* corresponding to the maximum allowed value of c.

In contrast to this result, we note that D(bold epsilon) has a minimum at bold epsilon* with respect to variations in bold epsilon which are restricted to the plane π(c*), as may be verified by forming the Lagrangian function

setting ∂Φ(bold epsilon)/∂λk|λ=λlowast = 0 gives the orthogonality condition at bold epsilon* for γ = −2, and ∂2Φ/∂λj∂λk = ∂2D/∂λj∂λk = 4Bjk implies that this stationary point is a minimum. Anticipating the physical interpretation of D as entropy production (see equation (28)), Prigogine's principle of minimum entropy production [5] may be seen as a special case of this latter type of constrained variation in which one or more components of F* is zero (say, F*k = 0 for 1 ≤ ks < m). Then within the plane π(c*) the complementary components of bold epsilon (i.e. λk for s < km) are fixed, and D(bold epsilon) has a minimum with respect to variation in the free components of bold epsilon (i.e. λk for 1 ≤ ks). This last statement is in fact somewhat more general than Prigogine's result, because it does not require the usual near-equilibrium assumption of linear constitutive relations.

In the MaxEnt distribution, the information concerning the constraints F is encoded in the vector of Lagrange multipliers bold epsilon via equation (6). It is then a matter of convenience whether we choose F or bold epsilon to describe the imposed constraints. By an argument identical to that leading to maximum dissipation in λ-space, the orthogonality condition in F-space (equation (18)) is equivalent to maximizing D(F) subject to the constraint D(F) = 2∑mk=1λ*kFk in which bold epsilon* is prescribed, the solution being a maximum on account of the positive definiteness of A.

We now consider the less restrictive problem in which the prior information C represents all of the available information, and Fk (1 ≤ km) represent free (linearly independent) variables to be determined from C. Here C includes not only the prior information (e.g. microscopic physics) determining the set of allowed outcomes 1 ≤ in, but also the conditions of the problem (e.g. steady-state conditions, critical thresholds) determining the set of variables Fk (1 ≤ km) that are linearly independent and their domain of allowed values in F-space. We wish to estimate the Fk from knowledge of C alone. A fundamental property of any such estimate, FC, is its redundancy in the sense that knowing both FC and C cannot alter our uncertainty about the outcomes based on knowledge of C alone. We may express this mathematically through the redundancy condition

Equation (23)

where S(FCC) and S(C) are the MaxEnt information entropies of the conditional probabilities p(i mid FCC) and p(i mid C) respectively. The distribution p(i mid FCC) is given by equation (5) with F = FC, and we now indicate explicitly the dependence of the corresponding information entropy, S(FCC), on the prior information C. As before, we consider the case where the functions fk are anti-symmetric over the outcomes (sensu equation (11)). In that case a dissipation function D(F) can be defined, as before, through p(i mid FC). Suppose now that D(F) has an upper bound Dmax(C) within the domain of F-space compatible with C. It may be shown from the orthogonality property of D(F) established above that the only estimate FC satisfying both the redundancy condition (equation (23)) and the upper bound constraint on D(F) is that for which D(F) attains its upper bound value Dmax(C) (see the appendix). Physically, this result corresponds to MEP (see below). Furthermore, in the special case where C admits only one independent variable F (i.e. m = 1) and where F itself has an upper bound Fmax(C), it may be shown similarly (see the appendix) that the only consistent estimate of F from C is Fmax(C). This latter result corresponds to various maximum flux principles in physics (see below). Other than the existence of the upper bounds Dmax(C) and Fmax(C), these results are independent of the specific nature of the constraint C. The property of maximum dissipation (and maximum flux) is generic to MaxEnt estimates of anti-symmetric functions.

So far we have deliberately avoided any physical interpretation in the derivation of the above results, in order to expose them as generic properties of MaxEnt which apply to a certain class of problems involving statistical inference from partial information. We now ask: if MaxEnt is fundamentally an algorithm of Bayesian statistical inference, why should we expect it to work as a description of nature? The answer is that, in its application to statistical mechanics, MaxEnt predicts that behaviour which is selected reproducibly by nature under the imposed constraints [2, 3]. The latter consist of the applied experimental conditions (constraints F or, equivalently, bold epsilon) together with the known or hypothesized microscopic physics defining the allowed microstates or phase-space trajectories (prior information C). Evidently, knowledge of FC alone must be sufficient to predict any result that nature reproduces under FC. This is precisely the information from which the MaxEnt distribution p(i mid FC) is constructed, and from which all physical observables are predicted through expectation values taken over p(i mid FC). In the less restrictive problem of estimating F from C, the redundancy condition of equation (23) is interpreted in physical terms as the requirement that FC is reproducibly selected under C. In statistical terms, reproducible behaviour simply means the most probable behaviour: it is reproducible precisely because it is characteristic of each of the overwhelming majority of microscopic states or paths consistent with the imposed constraints [2, 3].

To summarize, MaxEnt is a statistically based physical selection principle which extends Boltzmann's insight to non-equilibrium systems. It predicts the reproducible (i.e. most probable) behaviour selected under given constraints. However, the predictive success of MaxEnt (like that of equilibrium statistical mechanics) hinges on having correctly identified the constraints that actually apply in nature. In that respect MaxEnt (and hence the principles of maximum dissipation and maximum flux) remains essentially a trial-and-error procedure; its failures inform us of new constraints (new physics).

We now discuss the physical interpretation of the dissipation function D as entropy production. Recently the author applied MaxEnt to the non-equilibrium stationary behaviour of a finite system (volume V, boundary Ω) exchanging energy and matter with its environment [3]. There the possible outcomes consisted of microscopic phase-space paths Γ over a finite time interval τ. The constraints Fk took the general form of initial values (at t = 0) of some scalar density at each point x in V, denoted here by ρ(x, 0), together with the time-averaged values of the outward normal component of the corresponding flux density at each point x in Ω, denoted by , where the overbar indicates a time average over the interval t in (0, τ). The construction of the MaxEnt path distribution pΓ then proceeded as described above: the sum over k in equation (5) passes over, in the continuum limit, to spatial integrals over V and Ω, giving

Equation (24)

where α(x) and η(x) are Lagrange multipliers associated with ρ(x, 0) and , respectively. Contributions like equation (24) arising from different scalar densities ρ (e.g. internal energy, mass) combine additively. As shown in [3], α(x) on the boundary is related to η(x) through the local continuity equation that applies to each path Γ, ∂ρ(x, t)Γ/∂t = −∇ ⋅ F(x, t)Γ + Q(x, t)Γ, in which Q is a local source; specifically we find η(x) = −τα(x)/2. Therefore the exponent (path action) of the MaxEnt path distribution becomes

Equation (25)

The inclusion of the local density constraints ρ(x, 0), embodied in the first term of equation (25), leads to a physical interpretation of the Lagrange multiplier α(x) and hence of the second term in equation (25). Specifically, the requirement that pΓ corresponds to the Gibbs grand-canonical distribution in the equilibrium limit, , implies α = −1/kBT when ρ is the internal energy density and α = μ/kBT when ρ is the mass density of some chemical species, where T is temperature, μ is the species chemical potential and kB is Boltzmann's constant.

Retaining these identifications, we may consider the MaxEnt distribution constructed from the surface flux constraints alone, whose path action is the second term in equation (25),

Equation (26)

The point here is that now all the constraint functions are anti-symmetric (sensu equation (11)): the allowed microscopic paths Γ (whether they are governed by deterministic or stochastic equations of motion) can be grouped in pairs related by path reversal, under which is anti-symmetric. Therefore maximum dissipation applies as described above. When is the internal energy flux density (α = −1/kBT), for example, the mean dissipation is

Equation (27)

which may be identified with the (dimensionless) thermodynamic entropy exported across Ω during interval τ by heat flow; analogous contributions to D from mass flows across Ω combine additively. In the steady state, equation (27) may also be written as the volume integral

Equation (28)

which is the corresponding thermodynamic entropy production within V, the two terms in the integrand representing thermal and frictional dissipation, respectively. In physical terms, therefore, maximum dissipation translates to maximum entropy export, or equivalently in the steady state, maximum entropy production (MEP). Note, however, that stationarity is not a necessary condition for maximum entropy export; in equation (27), could represent the surface flux at x averaged over a small time interval τ during the (non-stationary) macroscopic evolution of the system.

We illustrate these general results with two physical examples. First, in Rayleigh–Bénard convection a fixed temperature gradient is imposed across a fluid layer enclosed between two horizontal conducting surfaces, corresponding to the case of prescribed bold epsilon* (inverse temperature gradient). In this one-dimensional problem, MEP then implies that the selected steady-state vertical heat flux across the fluid (F) is given by the maximum value of F allowed under bold epsilon*; this result may also be seen more directly as an application of the maximum flux principle. An analogous result holds for the momentum flux across a fluid layer subjected to a fixed shear. These upper bound transport principles have been shown to reproduce several key features of the observed vertical profiles of temperature and velocity in steady-state thermal and shear turbulence [11]. Alternatively, imposing a fixed heat input (prescribed F*) leads to selection of the maximum (inverse) temperature gradient (bold epsilon) allowed by F*.

Secondly, within a simple 10-box zonal model of Earth's climate, Paltridge [12] showed that MEP reproduces the observed zonal distributions of meridional heat transport, surface temperature and cloud fraction with remarkable accuracy. This application corresponds to the less restrictive problem where the variables Fk (horizontal heat flux between boxes k and k + 1) and λk (inverse temperature gradient between boxes k and k + 1) are free variables to be selected by the imposed constraints C (steady-state energy balance under prescribed solar radiation inputs at the top of the atmosphere). Paltridge's analysis also included the supplementary hypothesis that within each zone the surface-to-atmosphere convective transport of sensible and latent heat is maximal for a given configuration of horizontal heat fluxes Fk in the atmosphere and oceans. This additional 'convection hypothesis'—which predicts the homeostatic regulation of surface temperature by clouds [13]—is another example of the maximum flux principle obtained here from MaxEnt, in which it is assumed that adjustment of vertical convection occurs over a much shorter timescale than adjustment of the Fk. These and other applications of MEP are discussed in [14]. Except in the simplest cases, most physical applications of MEP correspond to the less restrictive problem of variable F and bold epsilon rather than prescribed F* or bold epsilon*.

The present derivation of MEP from MaxEnt refines and generalizes the less rigorous argument advanced previously [3]. It demonstrates explicitly the relationship between MEP and the FT via the orthogonality property of the dissipation function D, and furthermore shows how MEP, the FT and orthogonality of D are generic properties of MaxEnt distributions under anti-symmetric constraints. It also makes clear that in physical applications MEP applies to the entropy production of those linearly independent fluxes that are free to vary under the imposed constraints.

Finally, we comment briefly on the relationship between MaxEnt and previous theories of irreversible processes due to Onsager [4], Prigogine [5] and Ziegler [6]. Jaynes [1, 2] already noted that Onsager-type reciprocity relations (equation (7)) emerge naturally as generic properties of MaxEnt distributions, independently of any underlying physical assumptions. In addition, Županović et al [15] showed recently for the case of linear flux–force relationships that MEP is equivalent to the Onsager–Rayleigh principle of 'least dissipation of energy' (despite the name), and that MEP manifests itself as Kirchoff's loop law in linear electric networks and their analogues in chemical reaction networks [16]. In this work, the constitutive relations between F and bold epsilon derived from the FT (equations (15) and (16)) provide nonlinear generalizations of Onsager's linear flux–force relations, and imply that the Onsager–Rayleigh principle (MEP) may be extended to systems far from equilibrium.

As noted after equation (22), Prigogine's principle of minimum entropy production [5] can be interpreted within the MaxEnt formalism as a special case of the behaviour of the dissipation function D(bold epsilon) under variations in bold epsilon that are restricted to the plane π(c*). Maximum dissipation is a more general result which describes the behaviour of D(bold epsilon) under all possible variations in bold epsilon permitted by the imposed constraints and thus represents a physical selection principle under given constraints. MEP applies both close to and far from equilibrium.

In Ziegler's formalism [6], a dissipation function Φ = ΣkAk(d)vk was defined in terms of dissipative forces Ak(d) and corresponding velocities vk, with Φ being considered the fundamental quantity from which the dissipative forces were to be derived. Assuming Φ is given as a function of the vk alone, Ziegler derived the orthogonality condition Ak(d) ∝ ∂Φ/∂vk on the grounds that it is the only possible vectorial relation between Ak(d) and Φ. Then the principle of maximum dissipation followed as above. Ziegler's formalism is discussed further in the context of Earth's climate in [13]. MaxEnt provides a more fundamental statistical basis for the orthogonality condition. In MaxEnt the fundamental quantity is not the dissipation function D but the information entropy H, from whose maximization D emerges as a derived quantity. Via the FT, MaxEnt establishes MEP as a physical selection principle for the most probable configuration of macroscopic fluxes under given constraints.

Acknowledgments

I thank Alan McKane and an anonymous referee for valuable comments on the submitted manuscript. I am grateful to Davor Juretić and Pasko Županović for many stimulating discussions and access to their preprints. This work was supported by the French Département Environnement et Agronomie, INRA.

Appendix. Maximum dissipation and maximum flux principles under arbitrary constraints

Given the prior information C, let there be m linearly independent unknowns Fk (1 ≤ km). We wish to estimate the values of Fk from knowledge of C alone. This estimate, denoted by FC, must satisfy the redundancy condition, equation (23), as well as the upper bound constraint on the dissipation function, D(F) ≤ Dmax(C), within the domain of F-space compatible with C. The nature of the constraint C is otherwise arbitrary. The distribution p(i mid C) from which FC is to be estimated is obtained from MaxEnt by maximizing the information entropy

Equation (A.1)

subject to the three constraints

Equation (A.2)
Equation (A.3)
Equation (A.4)
In equation (A.2), S(FCC) is the MaxEnt information entropy of the conditional probability p(i mid FCC), and the estimate FC is to be recovered from p(i mid C) in the usual way (equation (2)),

Equation (A.5)

Inequality constraints like equation (A.3) can be incorporated into MaxEnt in a similar way to equality constraints [17]. We introduce the Lagrangian function

Equation (A.6)

in which α, β and γ are Lagrange multipliers. The only difference with regard to treatment of the inequality constraint on langDrang is that now we have two possibilities: either β = 0 and langDrang is strictly less than Dmax(C) (the constraint is inactive) or β ≠ 0 and langDrang = Dmax(C) (the constraint is active, i.e. maximum dissipation). Setting ∂ψ/∂p(i mid C) = 0 yields the solution

Equation (A.7)

in which λk arises from differentiating S(FCC) with respect to Fk as in equation (9), and the partition function Z(α, β) is a normalization factor arising from equation (A.4).

For the case β = 0 (constraint on langDrang inactive), we have

Equation (A.8)

Comparing equation (A.8) with equation (5), we see that in this case p(i mid C) coincides with the MaxEnt distribution specified by the Lagrange multiplier , and its information entropy is therefore given by . As established in the main text, the value bold epsilon = bold epsilon(FC) maximizes the dissipation function D(bold epsilon) subject to the constraint D(bold epsilon) = 2bold epsilonFC, and consequently for any finite α. Because the D-surface is essentially an inverted copy of the S-surface (see the main text), this last inequality implies that in violation of the redundancy condition (equation (A.2)). The case β = 0 is thereby excluded.

The redundancy condition can only be satisfied when β ≠ 0, i.e. the inequality constraint must be a strict equality: langDrang = Dmax(C). In many practical applications (e.g. physical systems with a large number of microscopic degrees of freedom) we can ignore fluctuations in f around its mean value FC (i.e. langDrang = D(FC)), and we therefore have D(FC) = Dmax(C). The MaxEnt estimate of F from the constraint C then coincides with the value of F that maximizes the dissipation function under C.

In the special case where C admits only one unknown F and where F itself has an upper bound Fmax(C), the same analysis with equation (A.3) replaced by

Equation (A.9)

shows that the only estimate of F from C satisfying both the redundancy condition (equation (A.2)) and the upper bound constraint on F is F = Fmax(C). In physical applications this result corresponds to various maximum flux principles (see the main text).

References

  • [1]
    Jaynes E T 2003 Probability Theory: the Logic of Science ed G L Bretthorst (Cambridge: Cambridge University Press)

    CrossRef

  • [2]
    Jaynes E T 1957 Phys. Rev. 106 620

    CrossRef

  • Jaynes E T 1957 Phys. Rev. 108 171

    CrossRef

  • Jaynes E T 1979 The Maximum Entropy Principle ed R D Levine and M Tribus (Cambridge, MA: MIT Press) p 15
  • Jaynes E T 1980 Ann. Rev. Phys. Chem. 31 579

    CrossRef

  • [3]
    Dewar R C 2003 J. Phys. A: Math. Gen. 36 631

    IOPscience

  • Dewar R C 2004 Non-Equilibrium Thermodynamics and the Production of Entropy ed A Kleidon and R Lorenz (Berlin: Springer) p 41
  • [4]
    Onsager L 1931 Phys. Rev. 37 237

    CrossRef

  • Onsager L 1931 Phys. Rev. 37 2265

    CrossRef

  • [5]
    Prigogine I 1962 Introduction to Non-Equilibrium Thermodynamics (New York: Wiley-Interscience)
  • [6]
    Ziegler H 1983 An Introduction to Thermomechanics (Amsterdam: North-Holland)
  • [7]
    Jaynes E T 1985 Maximum-Entropy and Bayesian Methods in Inverse Problems ed C R Smith and W T Grandy (Dordrecht: Reidel) p 21

    CrossRef

  • [8]
    Evans R M L 2005 J. Phys. A: Math. Gen. 38 293

    IOPscience

  • [9]
    Evans D J and Searles D J 2002 Adv. Phys. 51 1529

    CrossRef

  • [10]
    Maes C 1999 J. Stat. Phys. 95 333

    CrossRef

  • [11]
    Kerswell R R 2002 J. Fluid Mech. 461 239 and references therein

    CrossRef

  • [12]
    Paltridge G W 1978 Q. J. Met. Soc. 104 927

    CrossRef

  • [13]
    O'Brien D M and Stephens G L 1995 Q. J. Met. Soc. 121 1773

    CrossRef

  • [14]
    Ozawa H, Ohmura A, Lorenz R D and Pujol T 2003 Rev. Geophys. 41 1018

    CrossRef

  • Kleidon A and Lorenz R (ed) 2004 Non-Equilibrium Thermodynamics and the Production of Entropy (Berlin: Springer)
  • [15]
    Županović P, Juretić D and Botrić S 2005 Fizika A at press
  • [16]
    Županović P, Juretić D and Botrić S 2004 Phys. Rev. E 70 056108

    CrossRef

  • Županović P and Juretić D 2004 Croat. Chem. Acta 77 561
  • [17]
    Ishwar P and Moulin P 2003 IEEE Trans. Signal Process. 51 698

    CrossRef

Export references: BibTeX RIS

Citations

  1. Complexity and organization in hydrology: A personal view
    Rafael L. Bras  Water Resources Research 2015  51 6532

    CrossRef

  2. Dmitry S. Shalymov and Alexander L. Fradkov  2015  434

    CrossRef

  3. Communication: Maximum caliber is a general variational principle for nonequilibrium statistical mechanics
    Michael J. Hazoglou et al  The Journal of Chemical Physics 2015  143 051104

    CrossRef

  4. Field comparison of methods for estimating groundwater discharge by evaporation and evapotranspiration in an arid-zone playa
    Margaret Shanafield et al  Journal of Hydrology 2015 

    CrossRef

  5. Land surface energy partitioning revisited: A novel approach based on single depth soil measurement
    Jiachuan Yang and Zhi-Hua Wang  Geophysical Research Letters 2014  41 8348

    CrossRef

  6. Thermodynamic entropy fluxes reflect ecosystem characteristics and succession
    Henry Lin  Ecological Modelling 2014 

    CrossRef

  7. Small Open Chemical Systems Theory: Its Implications to Darwinian Evolution Dynamics, Complex Self-Organization and Beyond
    Qian Hong  Communications in Theoretical Physics 2014  62 550

    CrossRef

  8. Entropy Production Rate of Non-equilibrium Systems from the Fokker-Planck Equation
    Yu Haitao and Du Jiulin  Brazilian Journal of Physics 2014 

    CrossRef

  9. A model of energy budgets over water, snow, and ice surfaces
    Jingfeng Wang et al  Journal of Geophysical Research: Atmospheres 2014  n/a

    CrossRef

  10. Thermodynamic extremization principles and their relevance to ecology
    Jian D. L. Yen et al  Austral Ecology 2014  n/a

    CrossRef

  11. Entropy production and coarse graining of the climate fields in a general circulation model
    Valerio Lucarini and Salvatore Pascale  Climate Dynamics 2014 

    CrossRef

  12. Morphological assessment with the maximum entropy production rate (MEPR) postulate
    Yaw D Bensah and JA Sekhar  Current Opinion in Chemical Engineering 2014  3 91

    CrossRef

  13. An empirical evaluation of four variants of a universal species–area relationship
    Daniel J. McGlinn et al  PeerJ 2013  1 e212

    CrossRef

  14. An investigation into the Maximum Entropy Production Principle in chaotic Rayleigh-Bénard convection
    R.A.W. Bradford  Physica A: Statistical Mechanics and its Applications 2013 

    CrossRef

  15. Principles of maximum entropy and maximum caliber in statistical physics
    Steve Pressé et al  Reviews of Modern Physics 2013  85 1115

    CrossRef

  16. Nonequilibrium thermodynamics of circulation regimes in optically-thin, dry atmospheres
    Salvatore Pascale et al  Planetary and Space Science 2013 

    CrossRef

  17. Causal Entropic Forces
    A. D. Wissner-Gross and C. E. Freer  Physical Review Letters 2013  110

    CrossRef

  18. SOLUTION OF POPULATION BALANCE EQUATIONS IN EMULSION POLYMERIZATION USING METHOD OF MOMENTS
    Ehsan Vafa et al  Chemical Engineering Communications 2013  200 20

    CrossRef

  19. Modified saddle-point integral near a singularity for the large deviation function
    Jae Sung Lee et al  Journal of Statistical Mechanics: Theory and Experiment 2013  2013 P11002

    IOPscience

  20. Electric diffusion in cylindrical conductors from extended irreversible thermodynamics perspective
    F.E.M. Silveira  Physica A: Statistical Mechanics and its Applications 2012 

    CrossRef

  21. Natural selection. V. How to read the fundamental equations of evolutionary change in terms of information theory
    S. A. Frank  Journal of Evolutionary Biology 2012  25 2377

    CrossRef

  22. Entropy and ionic conductivity
    Yong-Jun Zhang  Physica A: Statistical Mechanics and its Applications 2012 

    CrossRef

  23. Maximum-entropy closure for a Galerkin model of an incompressible periodic wake
    Bernd R. Noack and Robert K. Niven  Journal of Fluid Mechanics 2012  1

    CrossRef

  24. Entropy production and viscosity of a dilute gas
    Yong-Jun Zhang  Physica A Statistical Mechanics and its Applications 2012 

    CrossRef

  25. Planetary Atmospheres as Nonequilibrium Condensed Matter
    J.B. Marston  Annual Review of Condensed Matter Physics 2012  3 285

    CrossRef

  26. A thermodynamic framework for constitutive modeling of time- and rate-dependent materials. Part I: Theory
    Rashid K. Abu Al-Rub and Masoud K. Darabi  International Journal of Plasticity 2012 

    CrossRef

  27. On Intelligence From First Principles: Guidelines for Inquiry Into the Hypothesis of Physical Intelligence (PI)
    Michael T. Turvey and Claudia Carello  Ecological Psychology 2012  24 3

    CrossRef

  28. Coupling diffusion and maximum entropy models to estimate thermal inertia
    Grey S. Nearing et al  Remote Sensing of Environment 2012  119 222

    CrossRef

  29. How does the Earth system generate and maintain thermodynamic disequilibrium and what does it imply for the future of the planet?
    A. Kleidon  Philosophical Transactions of The Royal Society A Mathematical Physical and Engineering Sciences 2012  370 1012

    CrossRef

  30. Extreme Energy Dissipation
    Adam Moroz  2012  1

    CrossRef

  31. Fractal variability: An emergent property of complex dissipative systems
    Andrew J. E. Seely and Peter Macklem  Chaos An Interdisciplinary Journal of Nonlinear Science 2012  22 013108

    CrossRef

  32. Comparison of entropy production rates in two different types of self-organized flows: Bénard convection and zonal flow
    Y. Kawazura and Z. Yoshida  Physics of Plasmas 2012  19 012305

    CrossRef

  33. A model of evapotranspiration based on the theory of maximum entropy production
    Jingfeng Wang and R. L. Bras  Water Resources Research 2011  47 W03521

    CrossRef

  34. A parametric sensitivity study of entropy production and kinetic energy dissipation using the FAMOUS AOGCM
    Salvatore Pascale et al  Climate Dynamics 2011 

    CrossRef

  35. A Journey from Science through Systems Science in Pursuit of Change
    Stanley N. Salthe  World Futures 2011  67 282

    CrossRef

  36. On the variational framework employing optimal control for biochemical thermodynamics
    Adam Moroz and David Ian Wimpenny  Chemical Physics 2011  380 77

    CrossRef

  37. Statistics of multifractal processes using the maximum entropy method
    V. Nieves et al  Geophysical Research Letters 2011  38 L17405

    CrossRef

  38. Entropy production and thermal conductivity of a dilute gas
    Yong-Jun Zhang  Physica A Statistical Mechanics and its Applications 2011  390 1602

    CrossRef ADS

  39. Charged Brownian particles: Kramers and Smoluchowski equations and the hydrothermodynamical picture
    R.E. Lagos and Tania P. Simões  Physica A Statistical Mechanics and its Applications 2011  390 1591

    CrossRef ADS

  40. Information flow and information production in a population system
    S. Nicolis  Physical Review E 2011  84 011110

    CrossRef

  41. Uncertainties have a meaning: Information entropy as a quality measure for 3-D geological models
    J. Florian Wellmann and Klaus Regenauer-Lieb  Tectonophysics 2011 

    CrossRef

  42. Present and Last Glacial Maximum climates as states of maximum entropy production
    Corentin Herbert et al  Quarterly Journal of the Royal Meteorological Society 2011  n/a

    CrossRef

  43. Comment on an information theoretic approach to the study of non-equilibrium steady states
    Glenn C Paquette  Journal of Physics A: Mathematical and Theoretical 2011  44 368001

    IOPscience

  44. Powerless fluxes and forces, and change of scale in irreversible thermodynamics
    M Ostoja-Starzewski and A Zubelewicz  Journal of Physics A: Mathematical and Theoretical 2011  44 335002

    IOPscience

  45. Non-equilibrium steady states: maximization of the Shannon entropy associated with the distribution of dynamical trajectories in the presence of constraints
    Cécile Monthus  Journal of Statistical Mechanics: Theory and Experiment 2011  2011 P03008

    IOPscience

  46. Large-deviation principles, stochastic effective actions, path entropies, and the structure and meaning of thermodynamic descriptions
    Eric Smith  Reports on Progress in Physics 2011  74 046601

    IOPscience

  47. Simultaneous extrema in the entropy production for steady-state fluid flow in parallel pipes
    Robert K. Niven  Journal of Non-Equilibrium Thermodynamics 2010  35 347

    CrossRef

  48. Selection Is Entailed by Self-Organization and Natural Selection Is a Special Case
    Rod Swenson  Biological Theory 2010  5 167

    CrossRef

  49. Ecosystem biogeochemistry considered as a distributed metabolic network ordered by maximum entropy production
    J. J. Vallino  Philosophical Transactions of The Royal Society B Biological Sciences 2010  365 1417

    CrossRef

  50. Minimization of a free-energy-like potential for non-equilibrium flow systems at steady state
    R. K. Niven  Philosophical Transactions of The Royal Society B Biological Sciences 2010  365 1323

    CrossRef

  51. Maximum Entropy Distributions of Scale-Invariant Processes
    Veronica Nieves et al  Physical Review Letters 2010  105 118701

    CrossRef

  52. From molecules to meteorology via turbulent scale invariance
    A. F. Tuck  Quarterly Journal of the Royal Meteorological Society 2010  n/a

    CrossRef

  53. Stability, complexity and the maximum dissipation conjecture
    C. Nicolis and G. Nicolis  Quarterly Journal of the Royal Meteorological Society 2010  n/a

    CrossRef

  54. Inferential closed-loop control of particle size and molecular weight distribution in emulsion polymerization of styrene
    Ehsan Vafa et al  Polymer Engineering and Science 2010  n/a

    CrossRef

  55. Maximum or minimum entropy production? How to select a necessary criterion of stability for a dissipative fluid or plasma
    A. Di Vita  Physical Review E 2010  81 041137

    CrossRef ADS APS Article

  56. MEP and planetary climates: insights from a two-box climate model containing atmospheric dynamics
    T. E. Jupp and P. M. Cox  Philosophical Transactions of The Royal Society B Biological Sciences 2010  365 1355

    CrossRef

  57. Maximum entropy production and plant optimization theories
    R. C. Dewar  Philosophical Transactions of The Royal Society B Biological Sciences 2010  365 1429

    CrossRef

  58. Bacterial chemotaxis and entropy production
    P. Zupanovic et al  Philosophical Transactions of The Royal Society B Biological Sciences 2010  365 1397

    CrossRef

  59. Maximum entropy production in environmental and ecological systems
    A. Kleidon et al  Philosophical Transactions of The Royal Society B Biological Sciences 2010  365 1297

    CrossRef

  60. The maximum entropy production principle: two basic questions
    L. M. Martyushev  Philosophical Transactions of The Royal Society B Biological Sciences 2010  365 1333

    CrossRef

  61. A basic introduction to the thermodynamics of the Earth system far from equilibrium and maximum entropy production
    A. Kleidon  Philosophical Transactions of The Royal Society B Biological Sciences 2010  365 1303

    CrossRef

  62. A New Statistical Dynamic Analysis of Ecosystem Patterns
    Xin Zhang and Li-He Chai  Environmental Modeling & Assessment 2010 

    CrossRef

  63. Thermodynamic analysis of snowball Earth hysteresis experiment: Efficiency, entropy production and irreversibility
    Valerio Lucarini et al  Quarterly Journal of the Royal Meteorological Society 2010  n/a

    CrossRef

  64. Non-equilibrium thermodynamics, maximum entropy production and Earth-system evolution
    A. Kleidon  Philosophical Transactions of The Royal Society A Mathematical Physical and Engineering Sciences 2010  368 181

    CrossRef

  65. The mechanics of granitoid systems and maximum entropy production rates
    B. E. Hobbs and A. Ord  Philosophical Transactions of The Royal Society A Mathematical Physical and Engineering Sciences 2010  368 53

    CrossRef

  66. Yi Chen et al  2010  3928

    CrossRef

  67. Nonequilibrium thermodynamics modeling of coupled biochemical cycles in living cells
    Yaşar Demirel  Journal of Non-Newtonian Fluid Mechanics 2010  165 953

    CrossRef

  68. Cooperative and collective effects in light of the maximum energy dissipation principle
    Adam Moroz  Physics Letters A 2010  374 2005

    CrossRef

  69. Modularity and Dissipation in Evolution of Macromolecular Structures, Functions, and Networks
    Gustavo Caetano-Anollés et al  2010  431

    CrossRef

  70. The Fourth Law of Thermodynamics: The Law of Maximum Entropy Production (LMEP) : An Interview with Rod Swenson
    Mayo Martínez-Kahn and León Martínez-Castilla  Ecological Psychology 2010  22 69

    CrossRef

  71. Life, hierarchy, and the thermodynamic machinery of planet Earth
    Axel Kleidon  Physics of Life Reviews 2010  7 424

    CrossRef

  72. Integral biomathics: A post-Newtonian view into the logos of bios
    Plamen L. Simeonov  Progress in Biophysics and Molecular Biology 2010  102 85

    CrossRef

  73. Nonequilibrium statistical mechanics of shear flow: invariant quantities and current relations
    A Baule and R M L Evans  Journal of Statistical Mechanics: Theory and Experiment 2010  2010 P03030

    IOPscience

  74. Applications of the principle of maximum entropy: from physics to ecology
    Jayanth R Banavar et al  Journal of Physics: Condensed Matter 2010  22 063101

    IOPscience

  75. Thermodynamic efficiency and entropy production in the climate system
    Valerio Lucarini  Physical Review E 2009  80 021118

    CrossRef

  76. Inferring species interactions in tropical forests
    I. Volkov et al  Proceedings of the National Academy of Sciences 2009  106 13854

    CrossRef

  77. Steady state of a dissipative flow-controlled system and the maximum entropy production principle
    Robert K. Niven  Physical Review E 2009  80 021113

    CrossRef ADS APS Article

  78. Energy flows in complex ecological systems: a review
    Jiang Zhang  Journal of Systems Science and Complexity 2009  22 345

    CrossRef

  79. A competitive coexistence principle?
    Cathy Neill et al  Oikos 2009 

    CrossRef

  80. Entropy of continuous Markov processes in local thermal equilibrium
    Miguel Hoyuelos  Physical Review E 2009  79 051123

    CrossRef

  81. How to Cope with Climate’s Complexity?
    Michel Crucifix  European Review 2009  17 371

    CrossRef

  82. Nonequilibrium thermodynamics and maximum entropy production in the Earth system
    Axel Kleidon  Naturwissenschaften 2009 

    CrossRef

  83. A model of surface heat fluxes based on the theory of maximum entropy production
    J. Wang and Rafael L. Bras  Water Resources Research 2009  45 n/a

    CrossRef

  84. Stochastic dynamics and non-equilibrium thermodynamics of a bistable chemical system: the Schlogl model revisited
    M. Vellela and H. Qian  Journal of The Royal Society Interface 2009  6 925

    CrossRef

  85. On the problem of the metastable region at morphological instability
    L.M. Martyushev and E.A. Chervontseva  Physics Letters A 2009  373 4206

    CrossRef

  86. Exact thermodynamic principles for dynamic order existence and evolution in chaos
    Shripad P. Mahulikar and Heinz Herwig  Chaos Solitons & Fractals 2009  41 1939

    CrossRef

  87. Nonlinear quantum evolution equations to model irreversible adiabatic relaxation with maximal entropy production and other nonunitary processes
    Beretta, Gian Paolo  Reports on Mathematical Physics 2009  64 139

    ADS

  88. On the extreme of internal entropy production
    Jiangnan Li  Journal of Physics A: Mathematical and Theoretical 2009  42 035002

    IOPscience

  89. MAXIMUM ENTROPY AND THE STATE-VARIABLE APPROACH TO MACROECOLOGY
    J. Harte et al  Ecology 2008  89 2700

    CrossRef

  90. Visions of Evolution: Self-organization Proposes What Natural Selection Disposes
    Stanley Salthe et al  Biological Theory 2008  3 17

    CrossRef

  91. The System of Interpretance, Naturalizing Meaning as Finality
    Stanley N. Salthe  Biosemiotics 2008 

    CrossRef

  92. Maximum Caliber: A variational approach applied to two-state dynamics
    Kingshuk Ghosh et al  The Journal of Chemical Physics 2008  128 194102

    CrossRef

  93. Properties of a nonequilibrium heat bath
    R. M. L. Evans et al  Physical Review E 2008  77 031117

    CrossRef

  94. Maximum Entropy Approach for Deducing Amino Acid Interactions in Proteins
    Jayanth R. Banavar et al  Physical Review Letters 2008  100 078102

    CrossRef

  95. Quantum-classical correspondence principles for locally nonequilibrium driven systems
    Eric Smith  Physical Review E 2008  77 021109

    CrossRef ADS APS Article

  96. Daisyworld: A review
    Hywel T. P. Williams et al  Reviews of Geophysics 2008  46 RG1001

    CrossRef ADS

  97. Spinodal decomposition of binary mixtures with composition-dependent heat conductivities
    Dafne Molin and Roberto Mauri  Chemical Engineering Science 2008  63 2402

    CrossRef

  98. On a variational formulation of the maximum energy dissipation principle for non-equilibrium chemical thermodynamics
    Adam Moroz  Chemical Physics Letters 2008  457 448

    CrossRef

  99. Thermodynamics of natural selection I: Energy flow and the limits on organization
    Eric Smith  Journal of Theoretical Biology 2008  252 185

    CrossRef

  100. A maximum hypothesis of transpiration
    Manuel Lerdau et al  Journal of Geophysical Research 2007  112 G03010

    CrossRef

  101. Maximum entropy production, cloud feedback, and climate change
    Graham D. Farquhar et al  Geophysical Research Letters 2007  34 L14708

    CrossRef

  102. Thermodynamics of irreversible transitions in the oceanic general circulation
    Shinya Shimokawa and Hisashi Ozawa  Geophysical Research Letters 2007  34 L12606

    CrossRef

  103. THEORY OF TRANSPORT PROCESSES AND THE METHOD OF THE NONEQUILIBRIUM STATISTICAL OPERATOR
    A. L. KUZEMSKY  International Journal of Modern Physics B 2007  21 2821

    CrossRef

  104. Natural selection in chemical evolution
    Chrisantha Fernando and Jonathan Rowe  Journal of Theoretical Biology 2007  247 152

    CrossRef

  105. Comments on a derivation and application of the 'maximum entropy production' principle
    G Grinstein and R Linsker  Journal of Physics A: Mathematical and Theoretical 2007  40 9717

    IOPscience

  106. A discussion on maximum entropy production and information theory
    Stijn Bruers  Journal of Physics A: Mathematical and Theoretical 2007  40 7441

    IOPscience

  107. Effect of Drought on Water Relations, Growth and Solute Accumulation in Two Sesame Cultivars
    F. Fazeli . et al  Pakistan Journal of Biological Sciences 2006  9 1829

    CrossRef

  108. Maximum entropy production and the strength of boundary layer exchange in an atmospheric general circulation model
    Edilbert Kirk et al  Geophysical Research Letters 2006  33 L06706

    CrossRef

  109. Entropy-based member selection in a GCM ensemble forecasting
    F. J. Tapiador and C. Gallardo  Geophysical Research Letters 2006  33 L02804

    CrossRef ADS

  110. Quantifying the biologically possible range of steady-state soil and surface climates with climate model simulations
    Axel Kleidon  Biologia 2006  61 S234

    CrossRef

  111. Using the principle of entropy maximization to infer genetic interaction networks from gene expression patterns
    T. R. Lezon et al  Proceedings of the National Academy of Sciences 2006  103 19033

    CrossRef

  112. Why is planet Earth so habitable?
    A. Kleidon  Geochimica et Cosmochimica Acta 2006  70 A323

    CrossRef

  113. The functional design of the rotary enzyme ATP synthase is consistent with maximum entropy production
    R.C. Dewar et al  Chemical Physics Letters 2006  430 177

    CrossRef

  114. Maximum entropy production principle in physics, chemistry and biology
    L.M. Martyushev and V.D. Seleznev  Physics Reports 2006  426 1

    CrossRef

  115. Equipartition of current in parallel conductors on cooling through the superconducting transition
    S Sarangi et al  Journal of Physics: Condensed Matter 2006  18 L143

    IOPscience

  116. Application of the maximum entropy production principle to electrical systems
    Thomas Christen  Journal of Physics D: Applied Physics 2006  39 4497

    IOPscience

  117. Complex systems: Order out of chaos
    John Whitfield  Nature 2005  436 905

    CrossRef ADS

Export citations: BibTeX RIS