ePubs
The open archive for STFC research publications
Home
About ePubs
Content Policies
News
Help
Privacy/Cookies
Suggest an Enhancement
Contact ePubs
Full Record Details
Persistent URL
http://purl.org/net/epubs/work/52291
Record Status
Checked
Record Id
52291
Title
An open and flexible distributed CPU usage accounting infrastructure for the WLCG and EGEE Grids
Contributors
M Jiang (STFC Daresbury Lab.)
,
C Del Cano Novales (STFC Rutherford Appleton Lab.)
,
G Mathieu (STFC Rutherford Appleton Lab.)
,
J Casson (STFC Rutherford Appleton Lab.)
,
J Gordon (STFC Rutherford Appleton Lab.)
Abstract
In WLCG/EGEE Grids, jobs are submitted by users to computing resources via a Grid Resource Broker (e.g. gLite Workload Management System). The usage of these resources is measured by recording the CPU usage of each user?s jobs and this provides a complete description of usage of these resources. The APEL (Accounting Processor for Event Logs) is the CPU usage accounting tool designed and deployed for the WLCG/EGEE Grids. As a log processing application, it interprets logs of Grid gatekeeper (e.g. globus) and batch system logs (e.g. PBS, LSF, SGE and Condor) to produce CPU job accounting records identified with Grid identities. APEL publishes accounting records into a repository at a Grid Operations Centre (GOC) for the access from a GUI web tool. The functions of log files parsing, record generation and publication are implemented by the APEL Parser, APEL Core, and APEL Publisher component respectively. In this paper, an APEL tool based distributed CPU usage accounting infrastructure for the WLCG/EGEE Grids is presented. Within the infrastructure, accounting records are transported from APEL Publishers at Grid sites to either a regionalised accounting system or the central one by choice via a common ActiveMQ broker network. This provides an open transport layer for other accounting systems to publish relevant accounting data to a central accounting repository in a unified interface and will give National Grid Initiatives (NGIs) flexibility in their choice of accounting system. The robust and secure delivery of accounting record messages at an NGI level and between NGI accounting instances and a central one is achieved with configurable APEL Publishers and ActiveMQ message brokers in the accounting infrastructure.
Organisation
ESC
,
STFC
,
ESC-SCT
Keywords
Physics
,
Grid
,
Accounting
,
SSTD 2009-2010
Funding Information
Related Research Object(s):
Licence Information:
Language
English (EN)
Type
Details
URI(s)
Local file(s)
Year
Presentation
Presented at 5th IEEE International Conference on e-Science .
APEL_Poster.pdf
2009
Showing record 1 of 1
Recent Additions
Browse Organisations
Browse Journals/Series
Login to add & manage publications and access information for OA publishing
Username:
Password:
Useful Links
Chadwick & RAL Libraries
SHERPA FACT
SHERPA RoMEO
SHERPA JULIET
Journal Checker Tool
Google Scholar