This site uses cookies. By continuing to use this site you agree to our use of cookies. To find out more, see our Privacy and Cookies policy.
The following article is Open access

Experiences with http/WebDAV protocols for data access in high throughput computing

, , , , , and

Published under licence by IOP Publishing Ltd
, , Citation Gerard Bernabeu et al 2011 J. Phys.: Conf. Ser. 331 072003 DOI 10.1088/1742-6596/331/7/072003

1742-6596/331/7/072003

Abstract

In the past, access to remote storage was considered to be at least one order of magnitude slower than local disk access. Improvement on network technologies provide the alternative of using remote disk. For those accesses one can today reach levels of throughput similar or exceeding those of local disks. Common choices as access protocols in the WLCG collaboration are RFIO, [GSI]DCAP, GRIDFTP, XROOTD and NFS. HTTP protocol shows a promising alternative as it is a simple, lightweight protocol. It also enables the use of standard technologies such as http caching or load balancing which can be used to improve service resilience and scalability or to boost performance for some use cases seen in HEP such as the "hot files". WebDAV extensions allow writing data, giving it enough functionality to work as a remote access protocol. This paper will show our experiences with the WebDAV door for dCache, in terms of functionality and performance, applied to some of the HEP work flows in the LHC Tier1 at PIC.

Export citation and abstract BibTeX RIS

Please wait… references are loading.
10.1088/1742-6596/331/7/072003