T Nakamura et al 2011 J. Phys.: Conf. Ser. 331 072025 doi:10.1088/1742-6596/331/7/072025
T Nakamura, H En'yo, T Ichihara, Y Watanabe and S Yokkaichi
Show affiliationsThe RIKEN Computing Center in Japan (CCJ) has been developed to make it possible analyzing huge amount of data corrected by the PHENIX experiment at RHIC. The corrected raw data or reconstructed data are transferred via SINET3 with 10 Gbps bandwidth from Brookheaven National Laboratory (BNL) by using GridFTP. The transferred data are once stored in the hierarchical storage management system (HPSS) prior to the user analysis. Since the size of data grows steadily year by year, concentrations of the access request to data servers become one of the serious bottlenecks. To eliminate this I/O bound problem, 18 calculating nodes with total 180 TB local disks were introduced to store the data a priori. We added some setup in a batch job scheduler (LSF) so that user can specify the requiring data already distributed to the local disks. The locations of data are automatically obtained from a database, and jobs are dispatched to the appropriate node which has the required data. To avoid the multiple access to a local disk from several jobs in a node, techniques of lock file and access control list are employed. As a result, each job can handle a local disk exclusively. Indeed, the total throughput was improved drastically as compared to the preexisting nodes in CCJ, and users can analyze about 150 TB data within 9 hours. We report this successful job submission scheme and the feature of the PC cluster.
29.40.Gx Tracking and position-sensitive detectors
07.05.Kf Data analysis: algorithms and implementation; data management
07.05.Bx Computer systems: hardware, operating systems, computer languages, and utilities
29.85.-c Computer data analysis
29.87.+g Nuclear data compilation
Accelerators, beams and electromagnetism
Issue 7 (2011)
T Nakamura et al 2011 J. Phys.: Conf. Ser. 331 072025
A Amann et al 2011 J. Phys.: Conf. Ser. 268 012001
A Amann et al 2008 J. Phys.: Conf. Ser. 138 012001
Nicola Brandonisio et al 2011 J. Opt. 13 125501
Waqqar Ahmed et al 2010 Nanotechnology 21 125605
James P Bagrow et al 2008 J. Phys. A: Math. Theor. 41 185001
Benjamin W Jacobs et al 2011 Nanotechnology 22 375601