Juan A Bonachela et al 2008 J. Phys. A: Math. Theor. 41 202001 doi:10.1088/1751-8113/41/20/202001
Entropy estimates of small data sets
FREE ARTICLEJuan A Bonachela1,2, Haye Hinrichsen2 and Miguel A Muñoz1
Show affiliationsFAST TRACK COMMUNICATION
Estimating entropies from limited data series is known to be a non-trivial task. Naïve estimations are plagued with both systematic (bias) and statistical errors. Here, we present a new 'balanced estimator' for entropy functionals (Shannon, Rényi and Tsallis) specially devised to provide a compromise between low bias and small statistical errors, for short data series. This new estimator outperforms other currently available ones when the data sets are small and the probabilities of the possible outputs of the random variable are not close to zero. Otherwise, other well-known estimators remain a better choice. The potential range of applicability of this estimator is quite broad specially for biological and digital data series.
- PACS
-
05.70.Ce Thermodynamic functions and equations of state
05.40.-a Fluctuation phenomena, random processes, noise, and Brownian motion
- MSC
-
94A17 Measures of information, entropy
82B30 Statistical thermodynamics (See also 80-XX)
60B12 Limit theorems for vector-valued random variables (infinite-dimensional case)
- Subjects
- Dates
-
Issue 20 (23 May 2008)
Received 21 December 2007, in final form 10 April 2008
Published 29 April 2008
-
Entropy estimates of small data sets
Juan A Bonachela et al 2008 J. Phys. A: Math. Theor. 41 202001
-
Protein simulations combining an all-atom force field with a Go term
Jan H Meinke and Ulrich H E Hansmann 2007 J. Phys.: Condens. Matter 19 285215
-
The exact perimeter generating function for a model of punctured staircase polygons
Iwan Jensen and Andrew Rechnitzer 2008 J. Phys. A: Math. Theor. 41 215002
-
The nuclear star cluster of the Milky Way
Rainer Schödel et al 2008 J. Phys.: Conf. Ser. 131 012044
-
The interplay between surface–water and hydrogen bonding in a water adlayer on Pt(111) and Ag(111)
Luigi Delle Site et al 2007 J. Phys.: Condens. Matter 19 242101
-
Doping poly[2-methoxy-5-(2'-ethylhexyloxy)-1,4-phenylenevinylene] with PbSe nanoparticles or fullerenes
D K Chambers et al 2008 J. Phys.: Condens. Matter 20 382202
-
Dephasing by electron–electron interactions in a ballistic Mach–Zehnder interferometer
Clemens Neuenhahn and Florian Marquardt 2008 New J. Phys. 10 115018
-
Linking optical and infrared observations with gravitational wave sources through transient variability
C W Stubbs 2008 Class. Quantum Grav. 25 184033
-
Implementation of standard testbeds for numerical relativity
M C Babiuc et al 2008 Class. Quantum Grav. 25 125012
-
Interplay between electronic states and structure during Au faceting
F Schiller et al 2008 New J. Phys. 10 113017
Users also read
What's this?- One-dimensional anyons with competing δ-function and derivative δ-function potentials
-
Discrete
-symmetric models of scattering
- Hannay angle and geometric phase shifts under adiabatic parameter changes in classical dissipative systems
Related review articles
What's this?- The effective temperature
- Unconventional phase transitions in a constrained single polymer chain
- On the uncertainty in the regularized solution