The following article is Open access

STAR load balancing and tiered-storage infrastructure strategy for ultimate db access

, , , and

Published under licence by IOP Publishing Ltd
, , Citation D Arkhipkin et al 2011 J. Phys.: Conf. Ser. 331 042028 DOI 10.1088/1742-6596/331/4/042028

1742-6596/331/4/042028

Abstract

In recent years, the STAR experiment's database demands have grown in accord not only with simple facility growth, but also with a growing physics program. In addition to the accumulated metadata from a decade of operations, refinements to detector calibrations force user analysis to access database information post data production. Users may access any year's data at any point in time, causing a near random access of the metadata queried, contrary to time-organized production cycles. Moreover, complex online event selection algorithms created a query scarcity ("sparsity") scenario for offline production further impacting performance. Fundamental changes in our hardware approach were hence necessary to improve query speed. Initial strategic improvements were focused on developing fault-tolerant, load-balanced access to a multi-slave infrastructure. Beyond that, we explored, tested and quantified the benefits of introducing a Tiered storage architecture composed of conventional drives, solid-state disks, and memory-resident databases as well as leveraging the use of smaller database services fitting in memory. The results of our extensive testing in real life usage are presented.

Export citation and abstract BibTeX RIS

Please wait… references are loading.
10.1088/1742-6596/331/4/042028