The open archive for STFC research publications

Full Record Details

Persistent URL http://purl.org/net/epubs/work/52291
Record Status Checked
Record Id 52291
Title An open and flexible distributed CPU usage accounting infrastructure for the WLCG and EGEE Grids
Abstract In WLCG/EGEE Grids, jobs are submitted by users to computing resources via a Grid Resource Broker (e.g. gLite Workload Management System). The usage of these resources is measured by recording the CPU usage of each user?s jobs and this provides a complete description of usage of these resources. The APEL (Accounting Processor for Event Logs) is the CPU usage accounting tool designed and deployed for the WLCG/EGEE Grids. As a log processing application, it interprets logs of Grid gatekeeper (e.g. globus) and batch system logs (e.g. PBS, LSF, SGE and Condor) to produce CPU job accounting records identified with Grid identities. APEL publishes accounting records into a repository at a Grid Operations Centre (GOC) for the access from a GUI web tool. The functions of log files parsing, record generation and publication are implemented by the APEL Parser, APEL Core, and APEL Publisher component respectively. In this paper, an APEL tool based distributed CPU usage accounting infrastructure for the WLCG/EGEE Grids is presented. Within the infrastructure, accounting records are transported from APEL Publishers at Grid sites to either a regionalised accounting system or the central one by choice via a common ActiveMQ broker network. This provides an open transport layer for other accounting systems to publish relevant accounting data to a central accounting repository in a unified interface and will give National Grid Initiatives (NGIs) flexibility in their choice of accounting system. The robust and secure delivery of accounting record messages at an NGI level and between NGI accounting instances and a central one is achieved with configurable APEL Publishers and ActiveMQ message brokers in the accounting infrastructure.
Organisation ESC , STFC , ESC-SCT
Keywords Physics , Grid , Accounting , SSTD 2009-2010
Funding Information
Related Research Object(s):
Licence Information:
Language English (EN)
Type Details URI(s) Local file(s) Year
Presentation Presented at 5th IEEE International Conference on e-Science . APEL_Poster.pdf 2009