M Nowak et al 2008 J. Phys.: Conf. Ser. 119 042024 doi:10.1088/1742-6596/119/4/042024
M Nowak3, D Malon1, P v Gemmeren1, A Schaffer4, S Snyder3, S Binet2 and K Cranmer3
Show affiliationsIn anticipation of data taking, ATLAS has undertaken a program of work to develop an explicit state representation of the experiment's complex transient event data model. This effort has provided both an opportunity to consider explicitly the structure, organization, and content of the ATLAS persistent event store before writing tens of petabytes of data (replacing simple streaming, which uses the persistent store as a core dump of transient memory), and a locus for support of event data model evolution, including significant refactoring, beyond the automatic schema evolution capabilities of underlying persistence technologies. ATLAS has encountered the need for such non-trivial schema evolution on several occasions already.
This paper describes the state representation strategy (transient/persistent separation) and its implementation, including both the payoffs that ATLAS has seen (significant and sometimes surprising space and performance improvements, the extra layer notwithstanding, and extremely general schema evolution support) and the costs (additional and relatively pervasive additional infrastructure development and maintenance). The paper further discusses how these costs are mitigated, and how ATLAS is able to implement this strategy without losing the ability to take advantage of the (improving!) automatic schema evolution capabilities of underlying technology layers when appropriate.
Implications of state representations for direct ROOT browsability, and current strategies for associating physics analysis views with such state representations, are also described.
29.40.Gx Tracking and position-sensitive detectors
Accelerators, beams and electromagnetism
Issue 4 (2008)
M Nowak et al 2008 J. Phys.: Conf. Ser. 119 042024
Y Girard et al 2008 J. Phys.: Conf. Ser. 100 052063
M Nagase and H Yamaguchi 2007 J. Phys.: Conf. Ser. 61 856
Youichi Yanase and Manfred Sigrist 2009 J. Phys.: Conf. Ser. 150 052287
Mikhail Prokopenko et al J. Stat. Mech. (2010) P11025
D Villamaina et al J. Stat. Mech. (2009) P07024
Dylan Walker et al J. Stat. Mech. (2007) P06010
Federico Corberi et al J. Stat. Mech. (2007) P07002
A P Georgopoulos et al 2010 J. Neural Eng. 7 016011
Sridhar Sunderam et al 2009 J. Neural Eng. 6 046009