Quick search Find article
Quick search
Find article

Data oriented job submission scheme for the PHENIX user analysis in CCJ

T Nakamura, H En'yo, T Ichihara, Y Watanabe and S Yokkaichi

Show affiliations


The RIKEN Computing Center in Japan (CCJ) has been developed to make it possible analyzing huge amount of data corrected by the PHENIX experiment at RHIC. The corrected raw data or reconstructed data are transferred via SINET3 with 10 Gbps bandwidth from Brookheaven National Laboratory (BNL) by using GridFTP. The transferred data are once stored in the hierarchical storage management system (HPSS) prior to the user analysis. Since the size of data grows steadily year by year, concentrations of the access request to data servers become one of the serious bottlenecks. To eliminate this I/O bound problem, 18 calculating nodes with total 180 TB local disks were introduced to store the data a priori. We added some setup in a batch job scheduler (LSF) so that user can specify the requiring data already distributed to the local disks. The locations of data are automatically obtained from a database, and jobs are dispatched to the appropriate node which has the required data. To avoid the multiple access to a local disk from several jobs in a node, techniques of lock file and access control list are employed. As a result, each job can handle a local disk exclusively. Indeed, the total throughput was improved drastically as compared to the preexisting nodes in CCJ, and users can analyze about 150 TB data within 9 hours. We report this successful job submission scheme and the feature of the PC cluster.


PACS

29.40.Gx Tracking and position-sensitive detectors

07.05.Kf Data analysis: algorithms and implementation; data management

07.05.Bx Computer systems: hardware, operating systems, computer languages, and utilities

29.85.-c Computer data analysis

29.87.+g Nuclear data compilation

29.40.Wk Solid-state detectors

07.05.Dz Control systems

Subjects

Accelerators, beams and electromagnetism

Nuclear physics

Instrumentation and measurement

Particle physics and field theory

Dates

Issue 7 (2011)



Related review articles

What's this?
View review articles related to this research to gain an insight into the key trends in this subject area. Related review articles are selected based on PACS/MSC codes, and are no more than three years old.

  1. The physics of solid-state neutron detector materials and geometries
  2. Time projection chambers
  3. Vavilov – Cherenkov radiation: its discovery and application
More

View by subject




Export






Please login to access our web services, or create an account if you don't yet have one.

You must have cookies enabled in your web browser to be able to login.

Username
Password

Forgotten your password? Get a new one here.