Antonio Possolo et al 2009 Metrologia 46 L1 doi:10.1088/0026-1394/46/1/N01
Antonio Possolo1, Blaza Toman1 and Tyler Estler2
Show affiliationsA recent contribution to this journal describes a particular situation of uncertainty assessment where probabilistically symmetric coverage intervals, produced in accordance with the Supplement 1 to the GUM, cover the measurand with frequency much smaller than their nominal coverage probability, in a long sequence of simulated repetitions of the measurement process and corresponding uncertainty assessment, in each of which the value of the measurand is assumed known.
These findings motivate our contribution to the ongoing, accelerating discussion of that Supplement, which began years before its publication, and has only gained momentum with the recent release of its final form.
We begin by suggesting that the coverage intervals whose frequentist performance has been found to be poor, indeed are coverage intervals for a quantity different from the measurand that is the focus of attention, and we offer a fresh viewpoint wherefrom to appreciate the situation.
Next, we point out that the Monte Carlo method for uncertainty propagation that is the core contribution of Supplement 1 is valid under very general conditions, indeed much more general than the conditions Supplement 1 lists as sufficient for its valid application.
To produce a coverage interval according to the Supplement 1 involves two steps: generating a sample of values of the measurand via a Monte Carlo procedure and then summarizing this sample into a coverage interval. Although the Supplement favours probabilistically symmetric intervals, it also states explicitly that other prescriptions are tenable. With this in mind, finally we explain that the choice of summarization can be interpreted as reflecting a priori beliefs about the measurand.
In the particular case under consideration in the motivating contribution, where the measurand is known to be non-negative, the choice of either a probabilistically symmetric interval or an interval whose left endpoint is 0 would correspond to two quite different prior beliefs. Considering this lesson, we suggest that, in all cases, the best course of action is to adopt a Bayesian approach that naturally reveals all participating assumptions and beliefs openly, and makes all of them accessible to examination and criticism, as befits every scientific procedure.
06.30.-k Measurements common to several branches of physics and astronomy
02.50.Ng Distribution theory and Monte Carlo studies
Issue 1 (February 2009)
Received 6 August 2008, in final form 5 November 2008
Published 6 January 2009
Antonio Possolo et al 2009 Metrologia 46 L1
Akihiro Kono 2003 J. Phys. D: Appl. Phys. 36 465
Keisuke Hatada et al 2009 J. Phys.: Conf. Ser. 190 012010
Yang Yan et al 2008 Chinese Phys. Lett. 25 597
Y Zhou et al 2009 New J. Phys. 11 113039
M Weiss and T Weissert 1991 Metrologia 28 65
Meijuan Yu et al 2009 J. Phys.: Conf. Ser. 190 012060
Emilio Elizalde and Jaume Haro 2009 J. Phys. A: Math. Theor. 42 472001
D J Craik 1974 J. Phys. D: Appl. Phys. 7 1566
C Johnson et al 2005 J. Phys. B: At. Mol. Opt. Phys. 38 119