K Wu et al 2009 J. Phys.: Conf. Ser. 180 012053 doi:10.1088/1742-6596/180/1/012053
K Wu1, S Ahern2, E W Bethel1,3, J Chen4, H Childs5, E Cormier-Michel1, C Geddes1, J Gu1, H Hagen3,6, B Hamann1,3, W Koegler4, J Lauret7, J Meredith2, P Messmer8, E Otoo1, V Perevoztchikov7, A Poskanzer1, Prabhat1, O Rübel1,3,6, A Shoshani1, A Sim1, K Stockinger1,10, G Weber1,3 and W-M Zhang9
Show affiliationsAs scientific instruments and computer simulations produce more and more data, the task of locating the essential information to gain insight becomes increasingly difficult. FastBit is an efficient software tool to address this challenge. In this article, we present a summary of the key underlying technologies, namely bitmap compression, encoding, and binning. Together these techniques enable FastBit to answer structured (SQL) queries orders of magnitude faster than popular database systems. To illustrate how FastBit is used in applications, we present three examples involving a high-energy physics experiment, a combustion simulation, and an accelerator simulation. In each case, FastBit significantly reduces the response time and enables interactive exploration on terabytes of data.
07.05.Tp Computer modeling and simulation
82.33.Vx Reactions in flames, combustion, and explosions
Issue 1 (2009)
K Wu et al 2009 J. Phys.: Conf. Ser. 180 012053
K Bradonjić et al 2009 J. Phys.: Conf. Ser. 161 012035
O Runevall and N Sandberg 2009 J. Phys.: Condens. Matter 21 335401
Z Liu et al 2009 J. Micromech. Microeng. 19 054008
Maximo Bañados et al JHEP05(2004)039
Michael S Summers et al 2009 J. Phys.: Conf. Ser. 180 012077
Jodi L Mead and Rosemary A Renaut 2009 Inverse Problems 25 025002
E W Bethel et al 2009 J. Phys.: Conf. Ser. 180 012084
Trilisa M Perrine and Barry D Dunietz 2007 Nanotechnology 18 424003