Distributed analysis in ATLAS using GANGA

Johannes Elmsheuser, Frederic Brochu, Greig Cowan, Ulrik Egede, Benjamin Gaidioz, Hurng Chun Lee, Andrew Maier, Jakub Móscicki, Katarina Pajchel, Will Reece, Bjorn Samset, Mark Slater, Alexander Soroko, Daniel Vanderster, Michael Williams

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

6 Citations (Scopus)

Abstract

Distributed data analysis using Grid resources is one of the fundamental applications in high energy physics to be addressed and realized before the start of LHC data taking. The needs to manage the resources are very high. In every experiment up to a thousand physicists will be submitting analysis jobs to the Grid. Appropriate user interfaces and helper applications have to be made available to assure that all users can use the Grid without expertise in Grid technology. These tools enlarge the number of Grid users from a few production administrators to potentially all participating physicists. The GANGA job management system (http://cern.ch/ganga), developed as a common project between the ATLAS and LHCb experiments, provides and integrates these kind of tools. GANGA provides a simple and consistent way of preparing, organizing and executing analysis tasks within the experiment analysis framework, implemented through a plug-in system. It allows trivial switching between running test jobs on a local batch system and running large-scale analyzes on the Grid, hiding Grid technicalities. We will be reporting on the plug-ins and our experiences of distributed data analysis using GANGA within the ATLAS experiment. Support for all Grids presently used by ATLAS, namely the LCG/EGEE, NDGF/NorduGrid, and OSG/PanDA is provided. The integration and interaction with the ATLAS data management system DQ2 into GANGA is a key functionality. An intelligent job brokering is set up by using the job splitting mechanism together with data-set and file location knowledge. The brokering is aided by an automated system that regularly processes test analysis jobs at all ATLAS DQ2 supported sites. Large numbers of analysis jobs can be sent to the locations of data following the ATLAS computing model. GANGA supports amongst other things tasks of user analysis with reconstructed data and small scale production of Monte Carlo data.

Original languageEnglish
Title of host publicationJournal of Physics: Conference Series
Subtitle of host publication17th International Conference on Computing in High Energy and Nuclear Physics, CHEP 2009; Prague; Czech Republic; 21 March 2009 through 27 March 2009
Number of pages6
Volume219
Edition1 PART 7
DOIs
Publication statusPublished - 1 Apr 2010
Externally publishedYes
EventInternational Conference on Computing in High Energy and Nuclear Physics (CHEP) 2009 - Prague, Czech Republic
Duration: 21 Mar 200927 Mar 2009
Conference number: 17th
https://iopscience.iop.org/volume/1742-6596/219 (Journal of Physics: Conference Series)

Publication series

NameJournal of Physics: Conference Series
PublisherIOP Publishing
ISSN (Print)1742-6588

Conference

ConferenceInternational Conference on Computing in High Energy and Nuclear Physics (CHEP) 2009
Abbreviated titleCHEP 2009
CountryCzech Republic
CityPrague
Period21/03/0927/03/09
Internet address

Cite this