System description

The reporting feature is built on top of the Platform Enterprise Reporting Framework (PERF) architecture. This architecture defines the communication between your EGO cluster, relational database, and data sources via the PERF Loader Controller (PLC). The loader controller is the module that controls multiple loaders for data collection.

Reporting architecture

The following diagram illustrates the reporting architecture as it relates to your cluster, reporting services, relational database, and data loaders.
Reporting architecture diagram

Data loaders

The reporting feature collects cluster operation data using data loaders to load data into tables in a relational database. The data loaders connect to the database using a JDBC driver. The data loaders handle daylight savings automatically by using GMT time when collecting data.

Default data loaders

The following are lists of the data loaders and default behavior:

Data loader name Data type Data gathering interval Data loads to Loader type
License Scheduler (bldloader) license usage 5 minutes 
BLD_LICUSAGE
 polling
Host metrics (hostmetricsloader) host-related metrics 5 minutes 
RESOURCE_METRICS
RESOURCES_RESOURCE_METRICS
 polling
Host properties (hostpropertiesloader) resource properties 1 hour 
LSF_RESOURCE_PROPERTIES
 polling
Bhosts (lsfbhostsloader) host utilization and state-related 5 minutes 
LSF_BHOSTS
 polling
LSF® events (lsfeventsloader) events with a job ID, performance events, resource events 60 seconds 
LSB_EVENTS
LSB_EVENTS_EXECHOSTLIST
LSF_PERFORMANCE_METRIC
  
Resource properties (lsfresproploader) shared resource properties 1 hour 
LSF_RESOURCE_PROPERTIES
 polling
SLA (lsfslaloader) SLA performance 5 minutes 
LSF_SLA
 polling
Shared resource usage (sharedresusageloader) shared resource usage 5 minutes 
SHARED_RESOURCE_USAGE
SHARED_RESOURCE_USAGE_HOSTLIST
 polling
Table 1. EGO data loaders
Data loader name Data type Data gathering interval Data loads to Loader type
Consumer resource (egoconsumerresloader) resource allocation 5 minutes 
CONSUMER_DEMAND
CONSUMER_RESOURCE_ALLOCATION
CONSUMER_RESOURCELIST
 polling
Dynamic metric (egodynamicresloader) host-related dynamic metric 5 minutes 
RESOURCE_METRICS
RESOURCES_RESOURCE_METRICS
 polling
EGO allocation events (egoeventsloader) resource allocation 5 minutes 
ALLOCATION_EVENT
 file
Static attribute (egostaticresloader) host-related static attribute 1 hour 
ATTRIBUTES_RESOURCE_METRICS
RESOURCE_ATTRIBUTES
 polling

System services

The reporting feature uses system services.

Loader controller

The loader controller service (plc) controls the data loaders that collect data from the system and writes the data into the database.

Data purger

The data purger service (purger) maintains the size of the database by purging old records from the database. By default, the data purger purges all data that is older than 14 days, and purges data every day at 3:00 am.

Job data transformer

The job data transformer service (jobdt) converts raw job data in the relational database into a format usable by the reporting feature. By default, the job data transformer converts job data every hour at thirty minutes past the hour (that is, at 12:30am, 1:30am, and so on throughout the day).