Reinforcing user data analysis with Ganga in the LHC era: Scalability, monitoring and user-support

Johannes Elmsheuser, Frederic Brochu, Ivan Dzhunov, Johannes Ebke, Ulrik Egede, Manoj Kumar Jha, Lukasz Kokoszkiewicz, Hurng Chun Lee, Andrew Maier, Jakub Mościcki, Tim München, Will Reece, Bjorn Samset, Mark Slater, David Tuckett, Daniel Vanderster, Michael Williams

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

1 Citation (Scopus)

Abstract

Ganga is a grid job submission and management system widely used in the ATLAS and LHCb experiments and several other communities in the context of the EGEE project. The particle physics communities have entered the LHC operation era which brings new challenges for user data analysis: a strong growth in the number of users and jobs is already noticeable. Current work in the Ganga project is focusing on dealing with these challenges. In recent Ganga releases the support for the pilot job based grid systems Panda and Dirac of the ATLAS and LHCb experiment respectively have been strengthened. A more scalable job repository architecture, which allows efficient storage of many thousands of jobs in XML or several database formats, was recently introduced. A better integration with monitoring systems, including the Dashboard and job execution monitor systems is underway. These will provide comprehensive and easy job monitoring. A simple to use error reporting tool integrated at the Ganga command-line will help to improve user support and debugging user problems. Ganga is a mature, stable and widely-used tool with long-term support from the HEP community. We report on how it is being constantly improved following the user needs for faster and easier distributed data analysis on the grid.

Original languageEnglish
Title of host publicationJournal of Physics: Conference Series
Subtitle of host publicationInternational Conference on Computing in High Energy and Nuclear Physics, CHEP 2010; Taipei; Taiwan; 18 October 2010 through 22 October 2010
Number of pages6
Volume331
EditionPART 7
DOIs
Publication statusPublished - 23 Dec 2011
Externally publishedYes
EventInternational Conference on Computing in High Energy and Nuclear Physics, CHEP 2010 - Taipei, Taiwan
Duration: 18 Oct 201022 Oct 2010

Publication series

NameJournal of Physics: Conference Series
PublisherIOP Publishing
ISSN (Print)1742-6588

Conference

ConferenceInternational Conference on Computing in High Energy and Nuclear Physics, CHEP 2010
CountryTaiwan
CityTaipei
Period18/10/1022/10/10

Cite this